-- Logs begin at Mon 2022-08-29 20:49:13 UTC, end at Mon 2022-08-29 21:52:30 UTC. -- Aug 29 21:25:36.102174 dv-cinder-854266-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:25:36.111020 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:25:36 2022] *** Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: nodename: dv-cinder-854266-3-iscsi Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: machine: x86_64 Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: clock source: unix Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: pcre jit disabled Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: detected number of CPU cores: 4 Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: current working directory: / Aug 29 21:25:36.112946 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:25:36.113662 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: your processes number limit is 47680 Aug 29 21:25:36.113662 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: your memory page size is 4096 bytes Aug 29 21:25:36.113662 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: detected max file descriptor number: 2048 Aug 29 21:25:36.113662 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: lock engine: pthread robust mutexes Aug 29 21:25:36.113662 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: thunder lock: enabled Aug 29 21:25:36.113662 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:25:36.113662 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:25:36.152273 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: Python main interpreter initialized at 0x55ad23ee39c0 Aug 29 21:25:36.152273 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: python threads support enabled Aug 29 21:25:36.152273 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: your server socket listen backlog is limited to 100 connections Aug 29 21:25:36.152273 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:25:36.152691 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:25:36.152691 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: *** Operational MODE: preforking *** Aug 29 21:25:36.152962 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:25:36.152962 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: spawned uWSGI master process (pid: 105743) Aug 29 21:25:36.153161 dv-cinder-854266-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:25:36.153687 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: spawned uWSGI worker 1 (pid: 105744, cores: 1) Aug 29 21:25:36.154439 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: spawned uWSGI worker 2 (pid: 105745, cores: 1) Aug 29 21:25:36.154439 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:25:36.813171 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:25:36.819357 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:25:37.903309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:37.903309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: from cryptography.utils import int_from_bytes Aug 29 21:25:37.903970 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:37.903970 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: from cryptography.utils import int_from_bytes Aug 29 21:25:37.928920 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:37.928920 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: from cryptography.utils import int_from_bytes Aug 29 21:25:37.929552 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:25:37.929552 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: from cryptography.utils import int_from_bytes Aug 29 21:25:40.433964 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:25:40.434635 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:25:40.434745 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:25:40.435073 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:25:40.435331 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:25:40.435708 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.436026 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.436345 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.436679 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.437002 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.437305 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.437620 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.437936 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.438096 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:25:40.438504 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.438596 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:25:40.438676 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.438789 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.438883 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:25:40.439111 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-iscsi {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.439217 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:25:40.439420 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.439522 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:25:40.439722 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.439853 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.440011 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.440190 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.440318 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.440524 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.440641 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.440886 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.440991 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.441235 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.441330 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.441552 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.441726 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.441877 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.442153 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.442283 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.442458 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.442575 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.442793 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.442907 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.443109 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.443233 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.443421 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.443601 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-iscsi {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.443784 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.443938 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.444091 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.444341 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.444507 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.444741 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.444877 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.445006 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.445338 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-iscsi {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.445516 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.445672 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.445941 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.446081 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.446245 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.446530 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.446673 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.446944 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.447083 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.447246 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.447558 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.447771 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.447980 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.448168 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.448365 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.448515 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.448675 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.448817 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.448908 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.449111 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.449245 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.449423 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.449514 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.449719 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.449824 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.450016 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.450108 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.450319 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.450414 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.450628 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.450720 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452064 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452173 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452270 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452357 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-iscsi {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452449 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452449 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452645 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452769 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452866 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.452952 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453042 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453130 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453219 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453298 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453377 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453454 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453539 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453631 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453711 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.453788 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.454012 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.454097 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.454309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.454423 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.454612 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.454720 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.454910 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.455008 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.455208 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.455305 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.455507 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.455618 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.455806 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.455926 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.456096 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.456239 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.456400 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.456576 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.456738 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.456920 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.457054 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.457228 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.457355 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.457537 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.457666 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.457813 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.458064 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.458691 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.458825 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.458964 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.459131 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.459263 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.459549 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.459635 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.459862 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.459963 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.460125 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.460222 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.460719 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.460928 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.461028 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.461347 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.461455 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.461725 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.461825 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.461989 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.462194 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.462498 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.462602 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.462896 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.463126 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.463466 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.463612 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.463913 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.464261 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.464403 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.464575 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.464799 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.465186 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.465600 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.465810 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.465981 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.465981 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.466311 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.466429 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.466520 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.466773 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.466899 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.466991 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467072 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467157 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467248 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467330 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467409 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467488 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467566 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467645 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467744 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467839 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.467921 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468005 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468095 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468216 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468342 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468431 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468678 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468782 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.468993 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.469094 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.469309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.469400 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.469611 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.469704 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.469909 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.470009 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.470209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.470307 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.470485 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.470582 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.470788 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.470883 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.471094 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.471181 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.471392 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.471490 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.471707 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.471806 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.472003 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.472090 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.472303 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.472390 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.472618 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.472724 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.472939 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.473092 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.473245 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.473389 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.473557 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.473676 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.473862 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.474468 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.474657 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.474791 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.475042 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.475144 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.475345 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.475488 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.475646 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.475874 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.476132 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.476341 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.476341 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.476901 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.477127 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.477267 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.477540 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.477673 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.477808 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.477808 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.478061 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.478194 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.478340 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.478608 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.478756 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.478886 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.479015 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.479150 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.479288 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.479544 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.479666 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.479805 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.479934 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.480141 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.480294 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.480417 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.480538 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.480687 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.480818 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.481010 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.481131 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.481261 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.481388 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.481507 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.481629 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.481766 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.481894 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.482013 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.482141 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.482261 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.482379 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.482514 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.482641 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.482762 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.482881 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.483054 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.483210 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.483343 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.483464 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.483634 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.483804 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.483950 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.484171 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.484307 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.484482 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.484627 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.484813 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.484937 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.485141 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.485266 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.485465 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.485594 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.485796 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.485929 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.486062 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.486184 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.486391 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.486584 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.486706 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.486838 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.486992 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.487131 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:25:40.487321 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.487455 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.487662 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.487851 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.487984 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.488205 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.488338 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.488477 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.488685 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.488808 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.488947 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.489070 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.489208 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.489390 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.489574 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.489710 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.489834 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.489957 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.490124 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.490248 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.490433 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.490574 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.490792 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.490922 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.491048 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.491175 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.491350 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.491493 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.491657 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.491782 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.491958 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.492092 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.492261 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.492394 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.492563 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.492718 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.492954 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.493078 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.493284 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.493409 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.493591 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.493780 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.493904 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.494122 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.494258 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.494450 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.494584 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.494766 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.494888 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.495082 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.495234 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.495366 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.495494 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.495668 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.495792 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.495963 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.496099 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.496260 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.496392 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.496673 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.496809 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.496954 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.497078 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.497203 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.497352 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.497477 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.497626 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.497763 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.498001 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.498135 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.498260 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.498395 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.498604 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.498740 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.498920 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.499053 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.499230 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.499354 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.499548 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.499730 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.499853 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.499983 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.500121 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.500245 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.500394 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.500517 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.500710 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.500847 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.501028 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.501150 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.501332 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.501465 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.501632 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.501757 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.501950 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.502075 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.502250 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.502372 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.502552 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.502675 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.502860 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.502993 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.503165 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.503290 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.503471 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.503605 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.503777 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.503919 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.504081 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.504203 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.504390 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.504512 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.504721 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.504859 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.505026 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.505637 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.505869 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.506043 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.506179 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.506324 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.506479 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.506629 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.506768 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.506893 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.507089 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.507236 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.507397 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.507565 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.507692 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.507882 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.508020 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.508197 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.508320 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.508505 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.508657 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.508845 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.508986 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.509150 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.509272 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.509452 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.509584 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.509753 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.510036 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.510171 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.510306 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.510430 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.510553 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.510678 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.510814 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.511029 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.511152 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.511336 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.511458 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.511635 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.511760 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.511984 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.512147 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.512275 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.512409 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.512549 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.512700 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.512866 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.512991 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.513201 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.513325 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.513532 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.513658 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.513866 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.514002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.514221 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.514345 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.514556 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.514678 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.514851 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.514974 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.515152 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.515299 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.515459 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.515600 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.515767 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.515950 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.516072 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.516221 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.516367 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.516501 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.516693 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.516832 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.517016 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.517151 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.517274 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.517399 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.517585 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.517709 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.517885 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.518022 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.518188 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.518322 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.518481 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.518614 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.518768 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.518895 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.519070 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.519205 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.519392 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.519517 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.519706 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.519853 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.520007 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.520137 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.520310 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.520434 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.520642 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.520817 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.521464 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.521594 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.521772 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.521906 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.522077 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.522212 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.522381 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.522503 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.522693 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.522816 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.522997 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.523120 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.523309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.523433 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.523613 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.523756 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.523929 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.524054 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.524231 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.524364 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.524542 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.524701 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.524869 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.525016 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.525174 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.525295 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.525511 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.525898 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.526136 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.526261 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.526441 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.526581 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.526748 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.526884 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.527066 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.527211 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.527353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.527479 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.527652 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.527776 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.527960 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.528097 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.528899 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529041 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529191 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529324 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529457 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529581 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529706 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529833 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.529970 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.530114 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.530304 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.530427 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.530574 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.530708 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.530860 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.530983 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.531110 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.531237 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.531365 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.531504 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.531629 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.531756 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.531883 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.532011 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.532137 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.532277 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.532403 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.532539 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.532698 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.532889 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533031 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533168 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533289 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533425 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533556 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533677 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533802 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.533937 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.534057 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.534186 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.534326 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.534472 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.534593 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.534771 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.534915 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.535079 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.535202 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.535400 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.535540 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.535698 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.535819 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.536007 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.536187 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.536334 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.536469 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.536677 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.536803 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.536991 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.537181 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.537340 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.537590 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.537797 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.537933 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.538128 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.538254 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.538492 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.538627 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.538802 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.538941 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.539105 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.539228 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.539414 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.539576 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.539708 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.539943 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.540140 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.540333 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.540490 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.540664 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.540789 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.540952 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.541077 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.541249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.541411 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.541551 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.541877 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.542009 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.542212 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.542461 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.542604 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.542965 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.543113 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.543239 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.543365 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.544159 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.544324 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.544482 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.544831 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.544955 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.545093 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.545330 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.545466 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.545636 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.545758 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.545883 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.545883 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.546115 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.546260 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.546398 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.546528 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.546664 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.546785 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.546918 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547051 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547194 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547329 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547455 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547575 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547575 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547824 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.547946 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.548069 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.548206 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.548360 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.548495 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.548640 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.548769 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.548893 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.549015 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.549155 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.549293 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.549425 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.549591 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.549714 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.549896 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.550019 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.550200 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.550332 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.550518 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.550672 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.550803 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.550931 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.551099 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.551224 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.551396 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.551529 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.551691 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.551834 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.552051 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.552176 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.552383 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.552552 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.552737 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.553052 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.553176 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.553389 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.553522 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.553690 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.553986 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.554123 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.554336 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.554459 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.554663 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.554786 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.554960 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.555093 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.555258 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.555394 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.555560 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.555684 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.555861 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.556022 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.556234 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.556369 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.556541 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.556719 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.556999 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.557148 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.557306 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.557447 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.557611 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.557784 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.557908 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.558117 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.558272 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.558506 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.558643 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.558821 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.558945 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.559137 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.559271 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.559447 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.559572 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.559758 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.559881 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.560065 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.560189 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.560378 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.560501 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.560762 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.560888 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561030 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561150 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561273 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561396 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561573 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561709 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561871 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.561995 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.562169 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.562293 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.562466 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.562606 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.562767 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.562890 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.563068 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.563191 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.563363 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.563500 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.563703 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.563824 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.564030 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.564152 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.564332 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.564466 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.564650 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.564779 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.564953 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.565076 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.565248 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.565372 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.565544 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.565668 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.565843 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.565977 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.566155 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.566280 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.566466 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.566641 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.566762 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.566889 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.567048 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.567175 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.567343 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.567467 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.568198 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.568341 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.568497 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.568765 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.568910 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.569094 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.569222 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.569431 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.569565 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.569873 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.570008 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.570143 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.570366 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.570507 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.570812 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.570941 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571073 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571201 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571328 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571469 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571594 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571732 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571867 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.571994 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.572127 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.572271 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.572397 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.572526 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.572679 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.572810 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.572959 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.573082 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.573210 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.573336 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.573472 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.573625 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.573762 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.573931 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.574055 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.574236 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.574361 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.574542 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.574679 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.574839 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.574963 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.575146 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.575270 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.575450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.575586 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.575754 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.575878 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.576048 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.576179 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.576345 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.576468 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.576683 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.576832 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.576989 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.577114 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.577294 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.577418 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.577608 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.577733 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.577922 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.578058 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.578241 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.578374 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.578533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.578656 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.578835 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.578960 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.579141 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.579271 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.579444 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.579576 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.579745 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.579886 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.580047 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.580172 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.580391 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.580513 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.580739 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.580881 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.581046 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.581191 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.581369 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.581493 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.581672 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.581815 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.581970 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.582093 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.582322 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.582456 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.582649 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.582786 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.582952 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.583075 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.583314 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.583940 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.584111 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.584234 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.584412 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.584538 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.584739 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.584880 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.585038 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.585162 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.585345 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.585468 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.585643 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.585768 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.586025 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.586149 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.586339 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.586474 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.586660 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.586849 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.586987 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.587109 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.587240 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.587364 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.587529 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.587672 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.587838 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.587961 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.588145 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.588271 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.588457 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.588681 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.588867 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.589008 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.589174 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.589313 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.589482 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.589624 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.589787 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.589912 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.590086 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.590210 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.590384 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.590521 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.590692 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.590824 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591007 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591185 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591323 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591448 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591576 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591704 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591869 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.591993 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.592186 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.592312 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.592483 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.592709 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.592848 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.592972 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.593109 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.593230 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.593430 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.593561 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.593740 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.593864 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.594048 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.594196 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.594357 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.594482 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.594667 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.594812 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.594975 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.595099 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.595298 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.595422 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.595607 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.595744 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.595911 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.596037 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.596222 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.596348 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.596527 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.596690 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.596886 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.597028 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.597188 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.597312 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.597489 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.597624 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.597795 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.597921 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.598093 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.598237 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.598467 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.598614 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.598743 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.598892 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.599071 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.599195 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.599395 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.599655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.599797 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.599976 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.600102 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.600284 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.600421 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.600726 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.600903 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.601026 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.601193 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.601335 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.601462 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.601615 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.601757 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.601917 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.602042 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.602215 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.602340 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.602513 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.602649 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.602827 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.602951 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.603123 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.603247 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.603424 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.603559 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.603727 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.603853 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.604022 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.604149 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.604318 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.604443 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.604638 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.604766 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.604960 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.605079 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.605260 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.605396 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.605650 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.605826 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.605952 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.606238 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.606385 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.606518 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.606643 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.606767 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.606892 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.607084 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.607238 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.607371 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.607511 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.607643 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.607809 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.607947 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.608118 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.608242 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.608434 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.608559 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.608776 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.608993 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.609117 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.609243 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.609416 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.609605 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.609730 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.609868 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.610050 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.610187 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.610316 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.610440 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.610640 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.610765 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.610967 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.611096 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.611283 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.611467 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.611610 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.611732 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.611874 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.612019 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.612144 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.612342 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.612482 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.612676 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.612802 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.613000 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.613123 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.613317 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.613461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.613621 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.613800 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.613924 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.614050 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.614189 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.614310 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.614505 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.614643 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.614822 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.614947 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.615120 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.615276 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.615434 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.615585 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.615802 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.615936 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.616076 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.616225 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.616349 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.616537 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.616701 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.616893 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.617052 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.617242 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.617366 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.617519 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.617644 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.617821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.617945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.618139 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.618265 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.618468 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.618593 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.618731 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.618859 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.619035 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.619169 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.619347 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.619470 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.619656 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.619790 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.619961 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.620083 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.620266 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.620388 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.620566 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.620745 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.620920 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.621053 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.621231 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.621366 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.621543 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.621688 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.621905 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.622094 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.622241 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.622416 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.622570 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.622706 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.622883 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.623006 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.623219 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.623356 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.623548 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.623672 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.623875 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.624015 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.624177 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.624314 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.624479 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.624677 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.624816 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.624950 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.625083 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.625215 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.625403 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.625526 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.625703 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.625826 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.626009 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.626135 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.626314 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.626438 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.626622 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.626748 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.626925 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.627048 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.627229 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.627414 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.627537 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.627679 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.627836 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.627960 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.628142 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.628274 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.628445 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.628604 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.628772 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.628896 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.629074 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.629202 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.629473 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.630700 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.630700 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.631725 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.631826 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.631898 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.631980 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632063 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632143 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632221 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632300 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632379 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632472 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632568 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632724 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632809 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632889 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.632957 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633039 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633110 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633177 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633261 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633347 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633569 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633667 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.633892 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.634033 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.634212 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.634301 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.634523 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.634781 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.634880 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.635100 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.635194 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.635517 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.635616 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.636423 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.636530 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.636647 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.636747 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.636831 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.636920 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637010 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637090 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637169 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637331 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637472 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637649 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637745 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.637967 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.638061 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.638270 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.638439 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.638566 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.638655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.638881 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.638968 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.639186 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.639287 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.639484 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.639562 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.639802 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.639905 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.640106 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.640257 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.640681 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.640772 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.640986 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.641065 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.641307 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.641401 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.641653 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.641841 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.641993 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.642156 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.642272 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.642732 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.642817 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.642901 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643022 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643160 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643280 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643383 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643486 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643628 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643825 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.643948 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.644215 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.644349 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.644517 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.644688 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.644863 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.645008 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.645169 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.645296 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.645473 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.645602 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.646309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.646441 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.646620 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.646810 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.646950 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.647149 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.647306 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.647506 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.647609 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.647807 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.647899 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.648118 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.648221 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.648427 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.648518 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.648759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.648851 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.649072 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.649177 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.649366 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.649658 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.649804 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.649951 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.650107 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.650243 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.650378 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.650546 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.650957 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.651122 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.651286 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.651441 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.651579 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.651775 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.651917 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.652078 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.652228 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.652423 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.652572 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.652818 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.652950 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.653101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.653245 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.653386 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.653529 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.653670 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.653810 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.653955 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.654087 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.654219 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.654347 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.654529 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.654665 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.654835 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.654972 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.655169 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.655304 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.655476 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.655711 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.656006 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.656099 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.656330 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.656416 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.656666 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.656757 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.656996 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.657084 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.657321 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.657415 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.657639 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.657789 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.657919 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.658006 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.658216 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.658301 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.658531 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.658624 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.658831 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.658916 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.659133 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.659218 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.659434 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.659533 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.659737 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.659823 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.660042 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.660127 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.660343 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.660441 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.660667 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.660754 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.660972 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.661057 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.661293 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.661382 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.661600 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.661686 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.661963 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.662049 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.662291 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.662377 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.662606 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.662698 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.662924 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.663024 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.663233 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.663321 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.663562 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.663647 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.663871 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.663970 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.664179 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.664266 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.664487 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.664633 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.664824 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.664929 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.665178 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.665270 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.665486 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.665572 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.665794 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.665887 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.666097 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.666181 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.666405 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.666528 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.666729 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.667060 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.667231 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.667462 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.667556 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.667791 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.667902 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.668062 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.668149 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.668374 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.668544 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.668731 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.668969 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.669058 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.669336 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.669421 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.669674 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.669826 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.669987 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.670213 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.670300 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.670594 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.670687 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.670933 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.671021 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.671352 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.671678 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.671773 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.671999 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.672092 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.672306 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.672405 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.672641 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.672754 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.672921 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.673078 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.673226 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.673450 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.673562 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.673771 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.673863 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.674107 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.674201 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.674432 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.674553 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.674755 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.674851 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.675111 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.675204 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.675423 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.675507 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.675724 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.675817 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.676022 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.676116 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.676324 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.676410 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.676668 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.676770 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.676999 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.677122 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.677297 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.677422 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.677593 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.677740 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.677923 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.678258 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.678541 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.678628 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.678853 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.678968 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.679154 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.679369 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.679536 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.679765 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.679896 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.680112 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.680198 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.680452 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.680538 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.680806 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.680910 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.681119 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.681377 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.681472 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.681728 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.681823 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.682067 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.682169 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.682373 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.682500 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.682687 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.682867 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.683005 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.683189 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.683314 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.683507 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.683616 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.683832 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.683942 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.684216 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.684309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.684489 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.684637 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.684827 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.684926 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.685157 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.685284 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.685454 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.685621 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.685958 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687110 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687340 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687420 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687638 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687713 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687787 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.687867 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688026 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688143 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688231 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688317 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688394 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688473 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688559 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688666 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688749 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688817 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688894 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.688961 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.689650 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.691454 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.693397 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.693495 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.693613 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.693717 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.693805 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.693887 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.693955 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694021 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694086 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694152 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694152 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694287 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694419 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694484 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694569 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694569 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694729 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694796 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694861 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.694926 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695011 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695011 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695174 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695299 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695395 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695395 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695538 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695607 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695687 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695761 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695836 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695902 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.695986 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696060 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696127 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696192 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696263 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696329 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696403 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696403 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:25:40.696539 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.696539 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699129 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699834 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699834 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.699968 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.700212 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.700537 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.700907 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.701229 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.701543 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.701881 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.702213 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704198 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704198 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704198 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704198 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704198 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704198 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704750 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704750 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.704972 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.705643 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.705643 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.705922 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.706267 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.706602 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.706917 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.707235 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.707547 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.707859 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.708223 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.709065 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.709381 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.709702 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.710030 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.710331 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.710662 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.710988 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.711300 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.711633 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.711958 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.712313 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.712648 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.713000 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.713332 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.713645 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.713958 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.714263 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:25:40.714510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:25:40.850981 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO dbcounter [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Registered counter for database nova_api Aug 29 21:25:40.872635 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_db.sqlalchemy.engines [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:40.872865 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO dbcounter [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Registered counter for database nova_api Aug 29 21:25:40.879661 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writer thread running {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:40.895901 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_db.sqlalchemy.engines [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:40.906554 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writer thread running {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:40.937917 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.context [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c54f11d2-4653-47b4-ba10-e11e8c2fda2e(cell1) {{(pid=105745) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:25:40.941744 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:40.942222 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:40.944373 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:40.945122 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:40.945559 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:40.947506 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:40.949476 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO dbcounter [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Registered counter for database nova_cell0 Aug 29 21:25:40.953491 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO dbcounter [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Registered counter for database nova_cell1 Aug 29 21:25:40.960683 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_db.sqlalchemy.engines [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:40.961907 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_db.sqlalchemy.engines [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:40.966068 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.context [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c54f11d2-4653-47b4-ba10-e11e8c2fda2e(cell1) {{(pid=105744) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:25:40.968263 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writer thread running {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:40.969930 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_concurrency.lockutils [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:40.970410 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_concurrency.lockutils [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:40.970506 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writer thread running {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:40.971953 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_concurrency.lockutils [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:40.972712 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_concurrency.lockutils [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:25:40.973152 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_concurrency.lockutils [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:25:40.975232 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_concurrency.lockutils [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:25:40.977358 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO dbcounter [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Registered counter for database nova_cell0 Aug 29 21:25:40.981310 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO dbcounter [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Registered counter for database nova_cell1 Aug 29 21:25:40.988608 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_db.sqlalchemy.engines [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:40.993059 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_db.sqlalchemy.engines [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:40.994964 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writer thread running {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:41.116480 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO dbcounter [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Registered counter for database nova_cell0 Aug 29 21:25:41.125317 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_db.sqlalchemy.engines [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:41.129981 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writer thread running {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:41.144300 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writer thread running {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:41.154093 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO dbcounter [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Registered counter for database nova_cell0 Aug 29 21:25:41.163041 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG oslo_db.sqlalchemy.engines [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:25:41.167771 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writer thread running {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:25:41.466799 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: WARNING keystonemiddleware.auth_token [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:41.474549 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: WARNING keystonemiddleware.auth_token [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:41.484650 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: WARNING keystonemiddleware.auth_token [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:41.492550 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: WARNING keystonemiddleware.auth_token [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:41.815147 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: WARNING keystonemiddleware.auth_token [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:41.821672 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: WARNING keystonemiddleware.auth_token [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:41.826891 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad23ee39c0 pid: 105745 (default app) Aug 29 21:25:41.829009 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:25:41.830238 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001836 Aug 29 21:25:41.830899 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Aug 29 21:25:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:25:41.833743 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: WARNING keystonemiddleware.auth_token [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:25:41.839707 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: WARNING keystonemiddleware.auth_token [None req-1d85d086-e997-4a16-85a8-a2f49c435a26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:25:41.844987 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad23ee39c0 pid: 105744 (default app) Aug 29 21:27:01.533719 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:01.535516 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002760 Aug 29 21:27:01.535911 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:01.548359 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writing DB stats nova_api:SELECT=3 {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.550203 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writing DB stats nova_cell0:SELECT=3 {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.551290 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writing DB stats nova_cell1:SELECT=3 {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.552048 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writing DB stats nova_cell0:SELECT=3 {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.429497 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-a1a08896-8cbc-4c68-81f1-b4c156edfd1d admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:02.462030 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-a1a08896-8cbc-4c68-81f1-b4c156edfd1d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918770 Aug 29 21:27:02.462761 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 21:27:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:04.907091 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:04.907908 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-ea497380-7dc6-4a0d-8c6c-686546e779e7 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Aug 29 21:27:04.908649 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:05.432890 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-d324df7c-0a98-472f-94c5-059dc370d465 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "ram": 256}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:05.493425 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-d324df7c-0a98-472f-94c5-059dc370d465 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.578827 Aug 29 21:27:05.494097 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:05.742190 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-ecf04069-05b7-43b7-9f95-daa9a2464a42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:05.762995 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_api:SELECT=3 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.763829 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_cell0:SELECT=3 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.764517 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_cell1:SELECT=3 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.765233 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.810441 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-ecf04069-05b7-43b7-9f95-daa9a2464a42 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.307210 Aug 29 21:27:05.810988 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 21:27:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:08.211900 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-d324df7c-0a98-472f-94c5-059dc370d465 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:08.213006 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-d324df7c-0a98-472f-94c5-059dc370d465 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 29 21:27:08.213592 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:08.895501 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-c03affe5-f5fa-49ff-9400-d8297556c7cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:08.936898 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-c03affe5-f5fa-49ff-9400-d8297556c7cd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717058 Aug 29 21:27:08.937728 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:08.950612 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-22c14276-29d8-44b2-91fa-744ff4fd49b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:08.991854 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-22c14276-29d8-44b2-91fa-744ff4fd49b1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045221 Aug 29 21:27:08.992773 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 21:27:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:11.415321 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-c03affe5-f5fa-49ff-9400-d8297556c7cd admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:11.416254 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-c03affe5-f5fa-49ff-9400-d8297556c7cd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 21:27:11.416685 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:11.819945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-ddf6817f-ae95-4835-a4a0-fb4eda43b69b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2"}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:11.841018 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-ddf6817f-ae95-4835-a4a0-fb4eda43b69b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418354 Aug 29 21:27:11.841576 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:11.853979 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-77508f35-eaa4-4ff3-98b8-a651f4c4a39d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:11.881579 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-77508f35-eaa4-4ff3-98b8-a651f4c4a39d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030830 Aug 29 21:27:11.882183 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 21:27:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:14.286674 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-ddf6817f-ae95-4835-a4a0-fb4eda43b69b admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.287680 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-ddf6817f-ae95-4835-a4a0-fb4eda43b69b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 29 21:27:14.288099 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:27:14.780135 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-0d337eaf-b6a6-4c7c-a193-7887f649c32f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d3", "vcpus": 2}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:14.800959 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-0d337eaf-b6a6-4c7c-a193-7887f649c32f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506672 Aug 29 21:27:14.801501 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:14.815243 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-36ca9ae2-3650-446d-bc5f-089d248f3b53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:14.848109 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-36ca9ae2-3650-446d-bc5f-089d248f3b53 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037294 Aug 29 21:27:14.849122 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 21:27:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:17.327568 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-0d337eaf-b6a6-4c7c-a193-7887f649c32f admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:17.328567 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-0d337eaf-b6a6-4c7c-a193-7887f649c32f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 29 21:27:17.328985 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:17.791141 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-908e5399-c492-4c94-b40b-6d14f1f07360 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "disk": 20, "vcpus": 4, "name": "ds4G", "swap": 0}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:17.814587 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-908e5399-c492-4c94-b40b-6d14f1f07360 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478271 Aug 29 21:27:17.815360 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:17.827440 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-1976c406-c1dc-4716-9e97-2f45d3908ec8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:17.851577 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-1976c406-c1dc-4716-9e97-2f45d3908ec8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027949 Aug 29 21:27:17.852246 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 21:27:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:20.614958 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-908e5399-c492-4c94-b40b-6d14f1f07360 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:20.616156 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-908e5399-c492-4c94-b40b-6d14f1f07360 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Aug 29 21:27:20.616716 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:27:21.169687 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-0326bc52-63d1-4b1d-8ec3-0139969feaac admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:21.209544 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-0326bc52-63d1-4b1d-8ec3-0139969feaac admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.585910 Aug 29 21:27:21.210445 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 21:27:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:24.118322 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-908e5399-c492-4c94-b40b-6d14f1f07360 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:24.119333 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-908e5399-c492-4c94-b40b-6d14f1f07360 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 29 21:27:24.119733 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:24.608775 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-671eac59-ef7d-4a65-aa22-5f185f2cf99f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:24.632405 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-671eac59-ef7d-4a65-aa22-5f185f2cf99f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.505867 Aug 29 21:27:24.633140 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:24.647875 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-59654e9c-b18e-4769-8861-60413c6d56b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:24.677168 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-59654e9c-b18e-4769-8861-60413c6d56b5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033096 Aug 29 21:27:24.677783 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 21:27:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:27.075470 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-671eac59-ef7d-4a65-aa22-5f185f2cf99f admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:27.076522 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-671eac59-ef7d-4a65-aa22-5f185f2cf99f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 29 21:27:27.077164 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:27.482371 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-2abcb2d1-5121-4b05-b5d8-f6cf2fb2cc14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:27.503500 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-2abcb2d1-5121-4b05-b5d8-f6cf2fb2cc14 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419530 Aug 29 21:27:27.504633 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:27.516559 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-cd4a11c7-f2db-47d0-82bf-c8ca20ac6091 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:27.544064 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-cd4a11c7-f2db-47d0-82bf-c8ca20ac6091 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031206 Aug 29 21:27:27.544669 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 21:27:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:29.992299 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-2abcb2d1-5121-4b05-b5d8-f6cf2fb2cc14 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:29.994017 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-2abcb2d1-5121-4b05-b5d8-f6cf2fb2cc14 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002237 Aug 29 21:27:29.999691 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:29 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:27:30.474205 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-bc9d979f-c146-4ae8-9585-e673392b4703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:30.496145 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-bc9d979f-c146-4ae8-9585-e673392b4703 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.494861 Aug 29 21:27:30.497019 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:30.509824 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-432f78f7-35dc-460f-abe0-7712c3c87b66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:30.541227 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-432f78f7-35dc-460f-abe0-7712c3c87b66 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035102 Aug 29 21:27:30.541907 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 21:27:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:33.003826 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-bc9d979f-c146-4ae8-9585-e673392b4703 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:33.004885 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-bc9d979f-c146-4ae8-9585-e673392b4703 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 29 21:27:33.006073 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:33.483358 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-037ad2ef-ba72-4ab5-87d8-00f4c7f72cb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:33.489899 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:33.506432 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-037ad2ef-ba72-4ab5-87d8-00f4c7f72cb9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.494601 Aug 29 21:27:33.506981 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:33.519528 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-6e34fadf-efde-41aa-b297-e23985d3b571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:33.545623 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-6e34fadf-efde-41aa-b297-e23985d3b571 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030057 Aug 29 21:27:33.546465 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 21:27:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:36.041157 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-037ad2ef-ba72-4ab5-87d8-00f4c7f72cb9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:36.043087 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-037ad2ef-ba72-4ab5-87d8-00f4c7f72cb9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002418 Aug 29 21:27:36.043747 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:36.595054 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-09958683-d9d4-4a68-a2b3-ace74171ff66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:36.618447 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-09958683-d9d4-4a68-a2b3-ace74171ff66 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.567527 Aug 29 21:27:36.619009 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 21:27:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:36.632029 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-d8635c83-f986-4eb1-ab79-43379024aaa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:36.661083 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-d8635c83-f986-4eb1-ab79-43379024aaa0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032720 Aug 29 21:27:36.662314 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 21:27:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:54.448905 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-09958683-d9d4-4a68-a2b3-ace74171ff66 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:54.449839 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-09958683-d9d4-4a68-a2b3-ace74171ff66 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 29 21:27:54.450275 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:54.461552 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:54.842402 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-3d002e55-33ed-4d9c-af18-294a839420bd admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:54.860448 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-3d002e55-33ed-4d9c-af18-294a839420bd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403266 Aug 29 21:27:54.861021 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 21:27:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:55.916662 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-09958683-d9d4-4a68-a2b3-ace74171ff66 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:55.917717 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-09958683-d9d4-4a68-a2b3-ace74171ff66 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 29 21:27:55.918114 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:56.444469 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-720d293f-1915-4ce2-bdab-e4a8c251c4be admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:56.450187 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.wsgi [None req-720d293f-1915-4ce2-bdab-e4a8c251c4be admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-720d293f-1915-4ce2-bdab-e4a8c251c4be admin admin] Request method failure captured: Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Accept: application/json Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Accept-Encoding: gzip, deflate Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Connection: keep-alive Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Content-Length: 0 Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Host: 10.222.0.20 Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Openstack-System-Scope: None Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: User-Agent: python-novaclient Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Auth-Token: gAAAAABjDS9b__5Mzi9j3ZAeHF9IBg9MPJuvIbsn8CxDpqxvwcDkp1CA1IXnY8S9_pLlh3AGc28B4enfKUVe0q4pZQ5T-onogMjawVIdv2fzeQwmkhknjHTLlmhy-WkAGOV09JK_zZgem1sloFr6Ta94TQepBSpKgv2rh2ZzbH28IBXKLma8qdc Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Domain-Id: None Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Domain-Name: None Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Identity-Status: Confirmed Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Is-Admin-Project: True Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Domain-Id: default Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Domain-Name: Default Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Name: admin Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Role: member,reader,admin Aug 29 21:27:56.453492 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Roles: member,reader,admin Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_918734ce2c8c4362a4d1364fce951bb2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant: admin Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant-Name: admin Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User: admin Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Domain-Id: default Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Domain-Name: Default Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Id: 3cc351f3cc8d45098e84aaabaeda36e6 Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Name: admin Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: method: > Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: exception: Flavor 42 could not be found. Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: action_args: {'id': '42'} Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:56.455510 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:56.456461 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.458002 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-720d293f-1915-4ce2-bdab-e4a8c251c4be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:56.459315 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-720d293f-1915-4ce2-bdab-e4a8c251c4be admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.400475 Aug 29 21:27:56.459315 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:56.465251 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-ac99639e-6212-496f-899a-13bf3acb035d admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:56.469316 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:56.489330 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-ac99639e-6212-496f-899a-13bf3acb035d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027595 Aug 29 21:27:56.489888 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:56.499735 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-7888be7a-a4e3-4414-a9c7-52cbbc4cc123 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:56.524961 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-7888be7a-a4e3-4414-a9c7-52cbbc4cc123 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028729 Aug 29 21:27:56.525528 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:56.535048 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-9d41f55f-8b48-407d-bf25-a152d9deeef8 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:56.541561 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.wsgi [None req-9d41f55f-8b48-407d-bf25-a152d9deeef8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-9d41f55f-8b48-407d-bf25-a152d9deeef8 admin admin] Request method failure captured: Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Accept: application/json Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Accept-Encoding: gzip, deflate Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Connection: keep-alive Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Content-Length: 0 Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Host: 10.222.0.20 Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Openstack-System-Scope: None Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: User-Agent: python-novaclient Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Auth-Token: gAAAAABjDS9b__5Mzi9j3ZAeHF9IBg9MPJuvIbsn8CxDpqxvwcDkp1CA1IXnY8S9_pLlh3AGc28B4enfKUVe0q4pZQ5T-onogMjawVIdv2fzeQwmkhknjHTLlmhy-WkAGOV09JK_zZgem1sloFr6Ta94TQepBSpKgv2rh2ZzbH28IBXKLma8qdc Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Domain-Id: None Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Domain-Name: None Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Identity-Status: Confirmed Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Is-Admin-Project: True Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Domain-Id: default Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Domain-Name: Default Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Name: admin Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Role: member,reader,admin Aug 29 21:27:56.544821 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Roles: member,reader,admin Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_918734ce2c8c4362a4d1364fce951bb2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant: admin Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant-Name: admin Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User: admin Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Domain-Id: default Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Domain-Name: Default Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Id: 3cc351f3cc8d45098e84aaabaeda36e6 Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Name: admin Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: method: > Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: exception: Flavor 42 could not be found. Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: action_args: {'id': '42'} Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:56.546209 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:56.547023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:56.548101 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-9d41f55f-8b48-407d-bf25-a152d9deeef8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:56.549238 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-9d41f55f-8b48-407d-bf25-a152d9deeef8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014781 Aug 29 21:27:56.549238 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:57.525348 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-7888be7a-a4e3-4414-a9c7-52cbbc4cc123 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:57.526391 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-7888be7a-a4e3-4414-a9c7-52cbbc4cc123 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 29 21:27:57.526949 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:58.091623 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-fec43098-5ebf-42ce-bb91-09113c53908e admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:58.097909 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.wsgi [None req-fec43098-5ebf-42ce-bb91-09113c53908e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-fec43098-5ebf-42ce-bb91-09113c53908e admin admin] Request method failure captured: Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Accept: application/json Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Accept-Encoding: gzip, deflate Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Connection: keep-alive Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Content-Length: 0 Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Host: 10.222.0.20 Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Openstack-System-Scope: None Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: User-Agent: python-novaclient Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Auth-Token: gAAAAABjDS9dmLeioMJb7T4ET0a6AN8rLe4QEglg-Lz-RWb9_KDGDywt3cXgeJZLrfhQ1y5EkE5dw73FSlhgNhnn8hxegHXFkz4qwApTxtEOG0mlCXGw6aGOX5zOkqpMkvr7aolGVFDiVRJdUW28NUPeuoLAnveS5XXF1klOe-OPHiXuHJPBFK0 Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Domain-Id: None Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Domain-Name: None Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Identity-Status: Confirmed Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Is-Admin-Project: True Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Domain-Id: default Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Domain-Name: Default Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Name: admin Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Role: member,reader,admin Aug 29 21:27:58.099450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Roles: member,reader,admin Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_918734ce2c8c4362a4d1364fce951bb2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant: admin Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant-Name: admin Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User: admin Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Domain-Id: default Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Domain-Name: Default Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Id: 3cc351f3cc8d45098e84aaabaeda36e6 Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Name: admin Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: method: > Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: exception: Flavor 84 could not be found. Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: action_args: {'id': '84'} Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:58.101049 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:58.105249 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.106419 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-fec43098-5ebf-42ce-bb91-09113c53908e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:58.107657 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-fec43098-5ebf-42ce-bb91-09113c53908e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.433316 Aug 29 21:27:58.107657 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 21:27:58.111830 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-6b6f7abf-0dcd-4548-9280-aa04fcbd24bf admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:58.127067 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-6b6f7abf-0dcd-4548-9280-aa04fcbd24bf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019788 Aug 29 21:27:58.127628 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:58.138688 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-61748a50-97f2-42dd-8a0c-b6a6bc6e84a9 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:58.156791 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-61748a50-97f2-42dd-8a0c-b6a6bc6e84a9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021781 Aug 29 21:27:58.157985 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:58.168426 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-202576af-0c0b-4241-b11c-4fa321fd1ac0 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:58.173821 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.wsgi [None req-202576af-0c0b-4241-b11c-4fa321fd1ac0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-202576af-0c0b-4241-b11c-4fa321fd1ac0 admin admin] Request method failure captured: Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Accept: application/json Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Accept-Encoding: gzip, deflate Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Connection: keep-alive Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Content-Length: 0 Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Host: 10.222.0.20 Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Openstack-System-Scope: None Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: User-Agent: python-novaclient Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Auth-Token: gAAAAABjDS9dmLeioMJb7T4ET0a6AN8rLe4QEglg-Lz-RWb9_KDGDywt3cXgeJZLrfhQ1y5EkE5dw73FSlhgNhnn8hxegHXFkz4qwApTxtEOG0mlCXGw6aGOX5zOkqpMkvr7aolGVFDiVRJdUW28NUPeuoLAnveS5XXF1klOe-OPHiXuHJPBFK0 Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Domain-Id: None Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Domain-Name: None Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Identity-Status: Confirmed Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Is-Admin-Project: True Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Domain-Id: default Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Domain-Name: Default Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Name: admin Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Role: member,reader,admin Aug 29 21:27:58.175320 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Roles: member,reader,admin Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_918734ce2c8c4362a4d1364fce951bb2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant: admin Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant-Name: admin Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User: admin Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Domain-Id: default Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Domain-Name: Default Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Id: 3cc351f3cc8d45098e84aaabaeda36e6 Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Name: admin Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: method: > Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: exception: Flavor 84 could not be found. Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: action_args: {'id': '84'} Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:58.176945 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:58.177837 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:58.179064 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-202576af-0c0b-4241-b11c-4fa321fd1ac0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:58.180395 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-202576af-0c0b-4241-b11c-4fa321fd1ac0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012358 Aug 29 21:27:58.180395 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:59.166326 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-61748a50-97f2-42dd-8a0c-b6a6bc6e84a9 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:59.167323 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-61748a50-97f2-42dd-8a0c-b6a6bc6e84a9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 29 21:27:59.167711 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:59.697568 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-a79854df-d3bf-49c7-beec-d5a5df2ff134 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:59.703261 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.wsgi [None req-a79854df-d3bf-49c7-beec-d5a5df2ff134 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-a79854df-d3bf-49c7-beec-d5a5df2ff134 admin admin] Request method failure captured: Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Accept: application/json Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Accept-Encoding: gzip, deflate Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Connection: keep-alive Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Content-Length: 0 Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Host: 10.222.0.20 Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Openstack-System-Scope: None Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: User-Agent: python-novaclient Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Auth-Token: gAAAAABjDS9ffsxlCOOsMSpS9pl7B9gYIS8rTLoQctdB8gFMlLxKjiup0CdMAlyieK6XqOVmODYhFqefAfBYu6lq9LPuANpGb64hWJxKnRTJhI7lH62rfqcZaOD6yRsjjlbRYmmyXzgLsYFGjYB_viSV3ZYMtRhpYe6PtoyIXFQ_quPsEzYZBIg Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Domain-Id: None Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Domain-Name: None Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Identity-Status: Confirmed Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Is-Admin-Project: True Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Domain-Id: default Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Domain-Name: Default Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Project-Name: admin Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Role: member,reader,admin Aug 29 21:27:59.704965 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Roles: member,reader,admin Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_918734ce2c8c4362a4d1364fce951bb2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant: admin Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-Tenant-Name: admin Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User: admin Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Domain-Id: default Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Domain-Name: Default Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Id: 3cc351f3cc8d45098e84aaabaeda36e6 Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: X-User-Name: admin Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: method: > Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: exception: Flavor 451 could not be found. Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: action_args: {'id': '451'} Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:59.706620 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:59.707655 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.709091 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-a79854df-d3bf-49c7-beec-d5a5df2ff134 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:59.710361 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-a79854df-d3bf-49c7-beec-d5a5df2ff134 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394952 Aug 29 21:27:59.710361 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 21:27:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:59.715863 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-a048a555-3ba4-4b97-8410-fe687a13139b admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:59.730729 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-a048a555-3ba4-4b97-8410-fe687a13139b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018376 Aug 29 21:27:59.731244 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:59.741203 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:59.756944 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019248 Aug 29 21:27:59.757481 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:59.766554 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-f2f451c1-8141-4a8b-b4c1-9b0952a9b83a admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:59.772023 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.wsgi [None req-f2f451c1-8141-4a8b-b4c1-9b0952a9b83a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-f2f451c1-8141-4a8b-b4c1-9b0952a9b83a admin admin] Request method failure captured: Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Accept: application/json Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Accept-Encoding: gzip, deflate Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Connection: keep-alive Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Content-Length: 0 Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Host: 10.222.0.20 Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Openstack-System-Scope: None Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: User-Agent: python-novaclient Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Auth-Token: gAAAAABjDS9ffsxlCOOsMSpS9pl7B9gYIS8rTLoQctdB8gFMlLxKjiup0CdMAlyieK6XqOVmODYhFqefAfBYu6lq9LPuANpGb64hWJxKnRTJhI7lH62rfqcZaOD6yRsjjlbRYmmyXzgLsYFGjYB_viSV3ZYMtRhpYe6PtoyIXFQ_quPsEzYZBIg Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Domain-Id: None Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Domain-Name: None Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Identity-Status: Confirmed Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Is-Admin-Project: True Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Domain-Id: default Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Domain-Name: Default Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Project-Name: admin Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Role: member,reader,admin Aug 29 21:27:59.773533 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Roles: member,reader,admin Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/918734ce2c8c4362a4d1364fce951bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_918734ce2c8c4362a4d1364fce951bb2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant: admin Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant-Id: 918734ce2c8c4362a4d1364fce951bb2 Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-Tenant-Name: admin Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User: admin Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Domain-Id: default Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Domain-Name: Default Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Id: 3cc351f3cc8d45098e84aaabaeda36e6 Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: X-User-Name: admin Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: method: > Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: exception: Flavor 451 could not be found. Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: action_args: {'id': '451'} Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:59.775353 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:59.776390 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: ERROR nova.api.openstack.wsgi Aug 29 21:27:59.777759 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-f2f451c1-8141-4a8b-b4c1-9b0952a9b83a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:59.779011 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-f2f451c1-8141-4a8b-b4c1-9b0952a9b83a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012074 Aug 29 21:27:59.779011 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 21:27:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 21:28:00.760113 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:00.761161 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 29 21:28:00.761586 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:01.293643 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-74fd4545-709f-4ca7-82f8-a83472008027 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:01.313289 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-74fd4545-709f-4ca7-82f8-a83472008027 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.411313 Aug 29 21:28:01.314380 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 21:28:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:28:02.286232 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:02.287244 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Aug 29 21:28:02.287740 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:28:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:02.836989 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-ae31db7e-5852-4ac8-90b6-fde14bf27039 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:02.865236 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-ae31db7e-5852-4ac8-90b6-fde14bf27039 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.438140 Aug 29 21:28:02.865460 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 21:28:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:28:03.854637 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:03.855644 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 29 21:28:03.856077 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:04.384700 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-719e5205-2e03-40cd-98d6-aed6f70d3cee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:04.404202 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-719e5205-2e03-40cd-98d6-aed6f70d3cee admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.410064 Aug 29 21:28:04.404766 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 21:28:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:28:05.396648 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:05.397663 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 29 21:28:05.398056 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:05.926867 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-3e5d131c-1400-4fe7-a2c2-82c44ba6971b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:28:05.945968 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-3e5d131c-1400-4fe7-a2c2-82c44ba6971b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408613 Aug 29 21:28:05.946514 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 21:28:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:28:06.946304 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:06.947502 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 29 21:28:06.947903 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:28:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:07.490653 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-e3bc4fce-7dab-4178-932b-af3658533193 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:07.511954 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-e3bc4fce-7dab-4178-932b-af3658533193 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.427465 Aug 29 21:28:07.512519 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Aug 29 21:28:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:29:02.205523 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:02.206721 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-347eb0ea-38ab-4438-a356-8a8c78f6efa9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002398 Aug 29 21:29:02.207125 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 21:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:29:02.218345 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:02.662220 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-39167859-e56f-452c-a5ad-7ccafdff851c admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:02.687884 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-39167859-e56f-452c-a5ad-7ccafdff851c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.473935 Aug 29 21:29:02.688471 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 21:29:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:29:02.722976 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-d02ff9c6-edb8-423b-bf16-bb610d5b8979 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:02.726554 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG dbcounter [-] [105744] Writing DB stats nova_api:SELECT=14 {{(pid=105744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:02.732200 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-d02ff9c6-edb8-423b-bf16-bb610d5b8979 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014352 Aug 29 21:29:02.732790 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Aug 29 21:29:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:29:02.746541 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-081c7dda-37fe-4149-9dd1-0707457ba83d admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:02.754560 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-081c7dda-37fe-4149-9dd1-0707457ba83d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011630 Aug 29 21:29:02.755309 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Aug 29 21:29:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:02.768058 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:02.776391 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013037 Aug 29 21:29:02.776974 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Aug 29 21:29:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:29:02.789986 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-3a74d513-1887-420b-9ca8-564cf2e1a398 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:29:02.797894 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-3a74d513-1887-420b-9ca8-564cf2e1a398 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012066 Aug 29 21:29:02.798409 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Aug 29 21:29:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:32:03.011208 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:03.012308 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 29 21:32:03.012642 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:32:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:03.152435 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_api:SELECT=6 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:03.324024 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:03.327860 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.328377 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.328840 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.330079 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:03.330528 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:03.330947 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:03.367583 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-96193e7a-8c5b-4a1c-848c-ec5ddae12384 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216631 Aug 29 21:32:03.368169 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 21:32:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:32:04.222247 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:04.223251 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 29 21:32:04.223651 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:32:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:04.420450 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:04.424577 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:04.425173 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:04.425687 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:04.426488 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:04.427032 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:04.427535 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:04.447881 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-1f477ee3-3bfb-42bb-a65f-9857e6d9c790 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083010 Aug 29 21:32:04.448364 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 21:32:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:32:15.701204 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:15.702513 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Aug 29 21:32:15.702964 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:15.849808 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_cell0:SELECT=4 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.850437 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_cell1:SELECT=4 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.851043 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG dbcounter [-] [105745] Writing DB stats nova_api:SELECT=8 {{(pid=105745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.907299 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:15.910733 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:15.911214 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:15.911640 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:15.912355 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:15.912828 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:15.913246 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:15.938395 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-89997ba0-9ac7-424e-bf57-da8ff018ec41 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093082 Aug 29 21:32:15.939503 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 21:32:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:16.778544 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: DEBUG nova.api.openstack.wsgi [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] Calling method '>' {{(pid=105744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:16.785066 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: INFO nova.api.openstack.requestlog [None req-e4a0e879-519d-43b4-908a-748a351c5e89 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003568 Aug 29 21:32:16.787083 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: [pid: 105744|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 21:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:32:17.006562 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG nova.api.openstack.wsgi [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] Calling method '>' {{(pid=105745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:32:17.010183 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:17.010979 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:17.011648 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:17.012519 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:17.012993 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:17.013415 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: DEBUG oslo_concurrency.lockutils [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:17.036945 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: INFO nova.api.openstack.requestlog [None req-5f544ca0-c736-40d4-b446-ecdd2adc21d2 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086938 Aug 29 21:32:17.037515 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: [pid: 105745|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 21:32:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:33:15.116890 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: Mon Aug 29 21:33:15 2022 - graceful shutdown triggered... Aug 29 21:33:15.117441 dv-cinder-854266-3-iscsi devstack@n-api.service[105745]: Gracefully killing worker 2 (pid: 105745)... Aug 29 21:33:15.116930 dv-cinder-854266-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 21:33:15.118289 dv-cinder-854266-3-iscsi devstack@n-api.service[105744]: Gracefully killing worker 1 (pid: 105744)... Aug 29 21:33:16.117197 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: worker 1 buried after 1 seconds Aug 29 21:33:16.117197 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: worker 2 buried after 1 seconds Aug 29 21:33:16.117197 dv-cinder-854266-3-iscsi devstack@n-api.service[105743]: goodbye to uWSGI. Aug 29 21:33:16.119286 dv-cinder-854266-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 21:33:16.119834 dv-cinder-854266-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 21:33:16.122707 dv-cinder-854266-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:33:16.132978 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:33:16 2022] *** Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: nodename: dv-cinder-854266-3-iscsi Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: machine: x86_64 Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: clock source: unix Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: pcre jit disabled Aug 29 21:33:16.135952 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: detected number of CPU cores: 4 Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: current working directory: / Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: your processes number limit is 47680 Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: your memory page size is 4096 bytes Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: detected max file descriptor number: 2048 Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: lock engine: pthread robust mutexes Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: thunder lock: enabled Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:33:16.136656 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:33:16.179743 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: Python main interpreter initialized at 0x55ce788789c0 Aug 29 21:33:16.179743 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: python threads support enabled Aug 29 21:33:16.179743 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: your server socket listen backlog is limited to 100 connections Aug 29 21:33:16.179743 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:33:16.180216 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:33:16.180216 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: *** Operational MODE: preforking *** Aug 29 21:33:16.180473 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:33:16.180473 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: spawned uWSGI master process (pid: 127206) Aug 29 21:33:16.180837 dv-cinder-854266-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:33:16.183478 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: spawned uWSGI worker 1 (pid: 127216, cores: 1) Aug 29 21:33:16.183478 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: spawned uWSGI worker 2 (pid: 127217, cores: 1) Aug 29 21:33:16.183478 dv-cinder-854266-3-iscsi devstack@n-api.service[127206]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:33:16.874526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:33:16.875134 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:33:18.081145 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:33:18.081145 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: from cryptography.utils import int_from_bytes Aug 29 21:33:18.081777 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:33:18.081777 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: from cryptography.utils import int_from_bytes Aug 29 21:33:18.116734 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:33:18.116734 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: from cryptography.utils import int_from_bytes Aug 29 21:33:18.117695 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:33:18.117695 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: from cryptography.utils import int_from_bytes Aug 29 21:33:20.591407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:33:20.592135 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:33:20.592273 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:33:20.592538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:33:20.592826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:33:20.593212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.593541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.593861 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.594180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.594667 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.594978 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.595302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.595622 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.595952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.596220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.596539 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.596893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-iscsi {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.597215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.597523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.597839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.598160 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.598465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.598789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.599096 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.599602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.600437 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.600778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.601098 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.601447 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.601788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.602079 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.602392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.602729 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.603037 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.603430 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.603839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-iscsi {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.604157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.604472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.604817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.605276 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.605677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.606083 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.607666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.607666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.607666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.607666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.608301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.608301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.608534 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.608915 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.609060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.609328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.609655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.609976 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.610269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.610640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.610928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.611254 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.611575 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.611903 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.612153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.612404 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.612750 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.613071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.613380 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.613687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.613993 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.614298 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.614603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.614908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.615213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.615553 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.615873 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.616194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.616518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.616851 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.617171 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.617598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.617854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.618157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.618501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.618843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.619122 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.619443 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.619767 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.620548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.620548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.620820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.621136 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.621462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.621767 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.622019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.622321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.622625 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.623007 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.623246 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.623551 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.623856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.624157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.624460 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.624796 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.625102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.627602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.631893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.632691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.632691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.632691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.632691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.632691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.632691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.632691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.633248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.633248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.633546 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.633934 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.634247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.634557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.634870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.635173 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.635480 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.635786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.636064 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.636388 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.636745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.637055 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.637362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.637666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.637984 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:20.638437 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.638745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.639091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.639405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.639739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.640123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.640383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.640722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.641038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.641364 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.641675 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.641988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.642299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.642617 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.642938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.643272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.643841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.643971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.644219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.644530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.644877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.645209 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.645532 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.645844 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.646185 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.646854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.647694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.648022 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.648344 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.648691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.649000 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.649311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.649636 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.649974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.650325 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.650610 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.650921 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.651244 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.651555 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.651863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.652175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.652487 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.652829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.653169 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.653487 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.653807 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.654125 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.654433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.654797 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.655153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.655474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.655772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.656076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.656380 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.656718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.657030 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.657333 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.657655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.657988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.658292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.658628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.658942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.659249 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.659556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.659869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.660174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.660489 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.660827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.661132 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.661464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.661781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.662084 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.662440 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.662744 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.663050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.663447 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.663761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.664092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.664385 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.664725 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.665057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.665369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.665686 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.666101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.666431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.666741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.667063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.667386 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.667704 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.668001 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.668309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.668648 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.668955 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.669257 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.669564 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.669865 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.670304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.670612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.670914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.671305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.671541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.671846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.672149 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.672452 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.672785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.673128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.673432 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.673775 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.674111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.674433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.674754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.675066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.675383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.675694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.676013 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.676317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.676721 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.677051 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.677364 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.678454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.678454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.678454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.678740 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.678937 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.679366 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.679612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.679984 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.680318 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.680660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.680985 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.681374 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.681670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.681963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.682343 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.682651 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.683019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.683342 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.683693 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.684024 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.684326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.684679 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.684993 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.685309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.685613 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.685927 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.686264 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.686588 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.686901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.687210 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.687528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.687840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.688221 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.688530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.688868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.689175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.689494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.689808 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.690118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.690498 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.690801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.691114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.691421 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.691874 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.692040 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.692393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.692754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.693065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.693388 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.694233 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.694538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.694851 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.695167 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.695476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.695853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.696151 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.696455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.696834 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.697147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.697487 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.697774 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.698091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.698402 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.698723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.699031 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.699341 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.699668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.699982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.700289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.700621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.700935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.701242 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.701552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.701877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.702319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.702481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.702986 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.703112 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.703387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.703790 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.704389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.704751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.705069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.705384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.705742 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.706053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.706384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.706882 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.707029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.707338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.707643 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.707946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.708248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.708556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.708919 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.710128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.710128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.710913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.710913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.711733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.711733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.711733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.712414 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.712414 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.712827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.712827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.713192 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.713396 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.713702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.714035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.714329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.714652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.714956 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.715300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.715624 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.715967 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.716272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.716575 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.716924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.717235 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.717539 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.717841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.718150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.718457 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.718756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.719065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.719373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.719680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.719987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.720287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.720630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.720916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.721228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.721538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.721838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.722138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.722445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.722752 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.723050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.723357 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.723653 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.723964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.724265 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.724565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.724940 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.725258 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.725565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.725868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.726197 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.726506 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.726810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.727113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.727424 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.727726 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.728078 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.728409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.728763 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.729080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.729384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.729689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.729992 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.730293 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.730594 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.730901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.731201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.731501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.731801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.732104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.732404 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.732751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.733059 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.733371 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.733669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.733970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.734314 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.734614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.735151 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.735469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.735781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.736101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.736410 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.736743 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.737058 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.737366 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.737680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.737989 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.738298 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.738600 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.738902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.739222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.739534 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.739843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.740160 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.740517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.740866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.741168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.741479 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.741788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.742096 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.742407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.742718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.743041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.743941 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.743941 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.744118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.744445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.744986 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.745420 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.745917 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.746228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.746619 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.746931 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.747245 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.747557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.747863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.748172 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.748491 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.748945 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.749264 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.749571 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.749878 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.750187 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.750498 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.750821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.751133 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.751439 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.751863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.752173 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.752482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.752820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.753127 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.753431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.753742 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.754071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.754379 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.754692 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.754989 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.755312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.755614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.756442 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.756899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.757213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.757518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.757939 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.758248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.758557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.758877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.759196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.759520 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.759825 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.760158 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.760451 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.760800 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.761124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.761436 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.761753 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.762058 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.762382 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.762702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.763045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.763367 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.763786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.764180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.764417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.764768 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.765093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.765396 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.765702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.766009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.766313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.766622 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.766941 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.767245 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.767554 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.767868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.768173 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.768474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.768801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.769121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.769425 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.769744 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.770055 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.770374 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.770695 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.771044 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.771363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.772479 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.772829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.773134 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.773440 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.773781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.774086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.774409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.774804 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.775062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.775375 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.775703 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.776028 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.776346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.776756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.777008 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.777315 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.777625 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.777936 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.778243 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.778550 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.778855 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.779165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.779467 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.779768 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.780071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.780392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.780720 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.781043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.781353 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.781658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.781964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.782269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.782609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.782916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.783243 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.783552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.783870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.784274 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.784632 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.784952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.785268 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.785586 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.785899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.786212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.786519 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.786836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.787149 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.787615 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.788387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.788906 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.789387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.789856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.790344 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.790797 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.791283 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.791723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.792207 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.792707 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.793212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.793609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.793877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.794211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.794550 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.794874 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.795193 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.795538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.795824 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.796190 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.796504 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.796840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.797173 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.797470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.797785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.798099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.798410 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.798725 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.799039 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.799352 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.799695 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.799979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.800291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.800637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.800974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.801293 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.801610 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.801924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.802234 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.802786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.803627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.803959 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.804284 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.804681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.804942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.805268 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.805617 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.805892 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.806307 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.806582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.806810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.807052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.807374 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.807683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.807988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.808312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.808640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.809266 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.809618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.809936 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.810261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.810584 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.810902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.811208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.811531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.811843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.812143 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.812460 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.812792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.813099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.813403 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.813718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.814023 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.814326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.814634 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.815009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.815259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.815565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.815867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.816172 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.816483 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.816810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.817116 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.817454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.817750 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.818111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.818331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.819202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.819506 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.819821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.820124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.820431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.820916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.821124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.821496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.821897 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.822272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.822584 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.822905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.823220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.823530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.823879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.824202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.824787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.825121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.825443 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.825781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.826128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.826417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.827114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.827114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.827339 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.827652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.827958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.828272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.828599 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.828913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.829223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.829532 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.839761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.840493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.841802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.842677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.843456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.843456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.843456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.843456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.843456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.844026 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.844026 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.844297 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.844690 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.844999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.845303 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.845607 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.845908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.846211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.846512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.846821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.847122 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.847423 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.847723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.848026 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.848331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.848684 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.849019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.849332 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.849658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.849999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.850352 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.850656 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.850977 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.851295 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.851611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.851918 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.852249 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.852558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.852891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.853205 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.853866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.853866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.854137 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.854430 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.854754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.855060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.855482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.855805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.856125 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.856442 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.856785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.857113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.857423 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.857732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.858041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.858357 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.858665 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.858993 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.859293 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.859668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.860202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.860500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.861136 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.861493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.862132 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.862250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.862581 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.862935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.863250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.863598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.863929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.864245 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.864559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.864903 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:20.865117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:33:20.928722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO dbcounter [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Registered counter for database nova_api Aug 29 21:33:20.950312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:20.957091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writer thread running {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.015027 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.context [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c54f11d2-4653-47b4-ba10-e11e8c2fda2e(cell1) {{(pid=127217) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:33:21.019438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.019913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.021824 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.022565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.023018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.025095 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.027100 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO dbcounter [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Registered counter for database nova_cell0 Aug 29 21:33:21.031168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO dbcounter [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Registered counter for database nova_cell1 Aug 29 21:33:21.038709 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:21.043839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:21.047867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writer thread running {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.227123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writer thread running {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.250853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO dbcounter [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Registered counter for database nova_cell0 Aug 29 21:33:21.251348 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:33:21.251819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:33:21.252107 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:33:21.252462 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:33:21.252743 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:33:21.253526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.253526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.253866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.254199 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.254672 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.254991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.255314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.255633 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.255995 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.256260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.256600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.256951 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-iscsi {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.257280 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.257592 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.257914 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.258236 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.258546 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.258873 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.259187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.259319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:21.259700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.260011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.260422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.260717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.261062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.261462 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.261682 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.262002 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.262310 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.262637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.262945 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.263485 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-iscsi {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.263673 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.263980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.264106 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writer thread running {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.264294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.264745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.265060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.265381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.265697 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.266031 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.266487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.266646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.266960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.267279 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.267605 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.267906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.268214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.268526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.268891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.269218 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.269523 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.269841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.270076 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.270406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.270724 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.271043 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.271319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.271871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.272148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.272464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.272803 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.273110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.273447 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.273725 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.274029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.274334 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.274641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.274944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.275268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.275590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.275909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.276219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.276537 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.277014 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.277270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.277543 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.277882 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.278202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.278552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.278874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.280096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.280096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.280096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.280096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.280785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.280785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.281135 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.281420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.281661 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.281831 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.282632 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.282632 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.283408 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.283408 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.283408 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.284264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.284264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.284264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.285017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.285017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.285506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.285506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.285978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.285978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.286479 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.286740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.287829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.287829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.288464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.288464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.288858 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.289013 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.289431 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.289613 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.289848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.290157 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.290481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.290788 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.291127 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.291420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.291715 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.292027 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.293332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.293332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.293332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.293332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.294143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.294143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.294143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.294584 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.294780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.295022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.295325 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.295646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.295955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.296263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.296565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.296917 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:33:21.297257 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.297589 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.297931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.298246 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.298578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.298915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.299233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.299716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.299851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.300181 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.300490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.300846 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.301233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.301481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.301801 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.302136 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.302453 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.302773 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.303891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.304005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.304268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.304672 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.304948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.305258 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.305599 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.305948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.306263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.306592 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.306919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.307553 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.307553 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.307893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.308157 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.308485 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.308838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.309160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.309476 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.309809 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.310118 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.310435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.310745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.311056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.311364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.311742 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.312018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.312350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.312683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.312998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.313315 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.313628 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.313960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.314249 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.314553 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.314857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.315162 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.315471 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.315774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.316095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.316422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.316760 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.317677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.317677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.317677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.317997 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.318307 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.318647 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.318957 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.319276 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.319582 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.319985 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.320213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.320517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.320870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.321183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.321490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.321809 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.322119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.322429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.322741 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.323081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.323374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.323685 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.324167 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.324330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.324947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.325049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.325302 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.325624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.325980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.326245 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.326551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.326852 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.327158 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.327464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.327825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.328071 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.328374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.328700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.329010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.329321 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.329645 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.330066 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.330247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.330556 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.330859 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.331201 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.331504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.331848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.332188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.332510 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.332862 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.333187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.333502 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.333815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.334151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.334474 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.334901 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.335107 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.335421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.335744 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.336059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.336387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.336722 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.337122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.337428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.337747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.338086 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.338441 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.338739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.339067 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.339380 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.339698 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.340009 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.340338 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.340649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.340961 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.341278 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.341590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.341908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.342212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.342533 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.342842 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.343162 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.343467 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.343775 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.344100 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.344521 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.344837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.345152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.345499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.345780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.346093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.346401 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.346708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.347015 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.347325 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.347642 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.347955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.348265 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.348569 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.348903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.349219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.349524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.350399 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.350652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.350982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.351287 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.352436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.352812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.353134 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.353446 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.353789 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.354093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.354403 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.354850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.355089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.355470 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.355687 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.356128 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.356449 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.356793 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.357115 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.357432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.357748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.358062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.358390 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.358704 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.359013 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.359372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.359640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.359955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.360266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.360680 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.360934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.361248 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.361560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.361871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.362185 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.362496 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.363082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.363502 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.363726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.364051 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.364414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.364807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.365145 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.366026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.366345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.366651 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.366962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.367267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.367639 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.367957 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.368262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.368694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.369248 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.369819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.370147 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.370564 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.371118 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.371545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.371875 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.372192 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.372511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.372906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.373319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.373644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.373957 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.374269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.374579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.374926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.375231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.375579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.375913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.376260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.376565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.376900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.377236 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.377545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.377886 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.378215 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.378518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.378831 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.379135 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.379447 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.379791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.380107 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.380421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.380751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.381088 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.381395 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.381711 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.382021 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.382327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.382684 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.382947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.383258 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.383559 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.383869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.384194 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.384478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.384807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.385114 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.385422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.385737 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.386050 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.386359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.386716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.386997 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.387300 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.387607 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.388108 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.388300 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.388518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.388863 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.389198 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.390317 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.390631 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.390949 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.391260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.391576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.391887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.392193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.392499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.392836 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.393143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.393454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.393758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.394333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.394560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.394695 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.394992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.395293 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.395640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.395944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.396306 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.397371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.397371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.397566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.397841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.398213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.398465 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.398770 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.399086 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.399400 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.399747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.400023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.400328 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.400678 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.401120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.401298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.402057 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.402057 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.402312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.403257 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.403257 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.403257 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.403594 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.403721 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.404152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.404454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.404664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.405096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.405295 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.405611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.405920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.406232 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.406585 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.406889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.407391 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.407527 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.407825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.408283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.408485 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.408750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.409056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.409503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.409822 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.410132 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.410441 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.410755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.411071 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.411389 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.411707 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.412015 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.412976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.413294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.413610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.413926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.414247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.414553 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.414865 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.415196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.415499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.415808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.416121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.416441 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.416846 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.417110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.417532 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.417847 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.418151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.418570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.418881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.419197 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.419519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.419842 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.420172 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.420476 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.420819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.421133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.421475 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.421784 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.422097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.422412 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.422720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.423047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.423371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.423686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.424011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.424429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.424781 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.425093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.425420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.425746 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.426053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.426360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.426672 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.426980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.427288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.427609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.428467 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.428800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.429111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.429426 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.429728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.430043 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.430356 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.430661 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.430984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.431300 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.431641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.431953 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.432261 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.432607 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.432916 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.433228 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.433529 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.433835 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.434185 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.434518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.434821 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.436088 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.436088 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.436088 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.436340 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.436522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.436874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.437193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.437523 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.437996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.438311 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.439195 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.439195 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.439476 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.439657 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.439841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.440150 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.440454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.440785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.441108 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.441420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.441742 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.442055 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.442365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.442676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.442980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.443330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.443690 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.444022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.444334 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.444692 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.445016 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.445327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.445649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.445961 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.446275 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.446597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.446905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.447216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.447533 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.447924 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.448158 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.448750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.449092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.449405 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.449718 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.450042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.450359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.450671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.450982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.451294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.451608 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.451920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.452251 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.452682 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.452923 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.453262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.453581 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.453895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.454210 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.454530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.454889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.455204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.455512 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.455823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.456165 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.456457 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.456807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.457210 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.457427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.459028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.459028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.459028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.459028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.459808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.460153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.460494 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.460852 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.461173 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.461492 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.461811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.462454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.468931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.469640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.470150 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.470570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.471017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.471473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.471903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.472248 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.472927 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.473302 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.473637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.473968 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.474306 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.474631 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.475580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.475969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.476284 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.476656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.476983 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.477365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.477614 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.478026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.478537 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.478908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.479350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.479675 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.480090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.480708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.481254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.481581 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.481900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.483002 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.483002 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.483238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.483556 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.484045 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.484444 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.484938 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.485558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.486218 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.486619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.486995 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.487459 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.487889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.488240 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.488562 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.488903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.489237 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.489696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.490034 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.490970 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.491314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.491714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.492158 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.493189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.493189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.493530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.493876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.494213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.494525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.494837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.495148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.495478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.496070 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.496506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.496787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.497211 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.497567 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.497935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.498312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.498725 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.499050 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.499517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.499764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.500138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.500578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.500976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.501356 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.501764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.502150 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.502534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.502925 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.503261 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.503575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.503892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.504205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.504519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.504866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.505205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.505522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.506009 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.506754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.507368 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.507887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.508470 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.508774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.509179 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.509726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.510112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.510416 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.510875 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.511071 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.511456 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.511754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.512120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.512397 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.512731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.513032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.513435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.513752 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.513973 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.514281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.514589 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.514909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.515219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.515530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.515837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.516395 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.516736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.517049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.517353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.517688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.518077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.518295 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.518608 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.518912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.519219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.519530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.519885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.520144 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.520435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.520811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.522287 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.522287 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.522615 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.522802 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.523130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.523560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.523748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.524074 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.524428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.524727 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.525063 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.525375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.525688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.526000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.526512 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.526764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.527079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.527411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.527739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.528046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.528366 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.528710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.529036 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.529352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.529665 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.529998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.530301 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.530613 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.530923 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.531233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.531544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.531859 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.532169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.532477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.532814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.533131 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.533708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.533880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.534181 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.534590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.534833 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.535185 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.535501 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.535847 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.536177 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.536652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.536955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.538406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:33:21.538406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:33:21.598489 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: WARNING keystonemiddleware.auth_token [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:33:21.601815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO dbcounter [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Registered counter for database nova_api Aug 29 21:33:21.606969 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: WARNING keystonemiddleware.auth_token [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:33:21.623228 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_db.sqlalchemy.engines [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:21.630332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writer thread running {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.691689 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.context [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c54f11d2-4653-47b4-ba10-e11e8c2fda2e(cell1) {{(pid=127216) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:33:21.697790 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.698322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.701315 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.701814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:21.702278 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:21.704670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:21.706900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO dbcounter [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Registered counter for database nova_cell0 Aug 29 21:33:21.711528 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO dbcounter [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Registered counter for database nova_cell1 Aug 29 21:33:21.720380 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_db.sqlalchemy.engines [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:21.721776 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_db.sqlalchemy.engines [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:21.726696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writer thread running {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.733006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writer thread running {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.886840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO dbcounter [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Registered counter for database nova_cell0 Aug 29 21:33:21.897486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_db.sqlalchemy.engines [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:33:21.903433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writer thread running {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:33:21.972198 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: WARNING keystonemiddleware.auth_token [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:33:21.978227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: WARNING keystonemiddleware.auth_token [None req-a8c4fd68-c968-4fdd-bdce-dbb98de00aec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:33:21.983585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ce788789c0 pid: 127217 (default app) Aug 29 21:33:22.256920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: WARNING keystonemiddleware.auth_token [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:33:22.264268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: WARNING keystonemiddleware.auth_token [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:33:22.609213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: WARNING keystonemiddleware.auth_token [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:33:22.616268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: WARNING keystonemiddleware.auth_token [None req-af21cd09-e387-4691-89d2-005db867b5fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:33:22.621945 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce788789c0 pid: 127216 (default app) Aug 29 21:33:59.768271 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:59.769417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:59.771148 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:59.772273 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:00.979029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9e2290db-9055-4c77-9a12-967a3ecf154d tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Action: 'create', calling method: .version_select at 0x7f5403b9ce50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-780597280"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:02.638285 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9e2290db-9055-4c77-9a12-967a3ecf154d tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.883554 Aug 29 21:34:02.639062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Aug 29 21:33:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2886 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:34:03.157952 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e93d515b-9283-4664-92e9-7b06192ca71a tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403bff9d0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:03.236959 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:03.237904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:03.239303 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:03.240563 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:03.922730 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e93d515b-9283-4664-92e9-7b06192ca71a tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a" status: 200 len: 345 microversion: 2.1 time: 1.271439 Aug 29 21:34:03.924286 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:02 2022] GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a => generated 345 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:03.939672 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-13da0b01-6c18-4dad-94d5-929ce4e29e2d tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Action: 'create', calling method: .version_select at 0x7f5403a20c10>, body: {"snapshot": {"volume_id": "d9c4c8ff-52de-43f4-b6ee-1c72c650a31a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-521768046"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:04.450015 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-13da0b01-6c18-4dad-94d5-929ce4e29e2d tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.515011 Aug 29 21:34:04.451030 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Aug 29 21:34:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:04.465943 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cfedf74c-5cb5-4af2-9c0a-f33072a0746d tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a52d30>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:04.585137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cfedf74c-5cb5-4af2-9c0a-f33072a0746d tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 200 len: 286 microversion: 2.1 time: 0.126514 Aug 29 21:34:04.586240 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:34:04 2022] GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:04.597857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a432955f-494c-4a9d-b116-f08439128c8b tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a36dc0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:04.681275 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a432955f-494c-4a9d-b116-f08439128c8b tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.087427 Aug 29 21:34:04.681831 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 29 21:34:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:04.696980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2a82f667-69ed-49a6-a476-5a7ec3c27ddd tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a52af0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:04.732522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2a82f667-69ed-49a6-a476-5a7ec3c27ddd tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 200 len: 286 microversion: 2.1 time: 0.040302 Aug 29 21:34:04.733791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:34:04 2022] GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:05.746215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-754b5de8-7f2e-4ce4-810e-dd4545c7867f tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a36af0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:05.828988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-754b5de8-7f2e-4ce4-810e-dd4545c7867f tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 200 len: 286 microversion: 2.1 time: 0.086633 Aug 29 21:34:05.830122 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:34:05 2022] GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:06.842557 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-02657f93-578b-4299-ac6b-365000dae712 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a18550>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:06.906866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-02657f93-578b-4299-ac6b-365000dae712 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 200 len: 286 microversion: 2.1 time: 0.068951 Aug 29 21:34:06.914748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:34:06 2022] GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:07.919954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f462763f-3f3e-4982-9385-dc54b20a5a30 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a36550>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:08.059632 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f462763f-3f3e-4982-9385-dc54b20a5a30 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 200 len: 287 microversion: 2.1 time: 0.143394 Aug 29 21:34:08.064964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:34:07 2022] GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:08.073743 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-71a596df-63d8-4bc4-b14f-d1059d8c45dd tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a18c10>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:08.663996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-71a596df-63d8-4bc4-b14f-d1059d8c45dd tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 202 len: 0 microversion: 2.1 time: 0.594721 Aug 29 21:34:08.664818 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 29 21:34:08 2022] DELETE /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:34:08.672957 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-de8ec153-28a0-414b-8d66-5a41109ed705 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a20e50>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:08.732965 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-de8ec153-28a0-414b-8d66-5a41109ed705 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 200 len: 286 microversion: 2.1 time: 0.063747 Aug 29 21:34:08.733983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:34:08 2022] GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:09.745552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4a29573c-1b2c-4f55-8926-6de746cc4719 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a18ca0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:09.786204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-4a29573c-1b2c-4f55-8926-6de746cc4719 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] HTTP exception thrown: Snapshot e38bb60f-8b74-4bda-a747-53e88d2e06a8 could not be found. Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4a29573c-1b2c-4f55-8926-6de746cc4719 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Request method failure captured: Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 HTTP/1.1 Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDHMR1lK4Wiuv7yEryU9o7P-SYQCyY_K_SSfJOxaWftzKLCa25xYQX0xWCfKpSo521j_5GTcOkErcFnHpWecDJ5zOc81dnbzCgDhfWdqE8xMdbSbIAV9E-XaGCpxK2vX120H8-u84OTiD82AhYEOm4ij34uhBYWioVE5nIoi4YPCug Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:34:09.790309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_23e5e8ff1d1f45a1a9d1f01889f496b1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 6f1bdcc244f9484f8aca8f5e59839027 Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Snapshot e38bb60f-8b74-4bda-a747-53e88d2e06a8 could not be found. Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'e38bb60f-8b74-4bda-a747-53e88d2e06a8'} Aug 29 21:34:09.791478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e38bb60f-8b74-4bda-a747-53e88d2e06a8 could not be found. (HTTP 404) (Request-ID: req-aafa9ca3-a51d-42e5-bd39-ecf28b663ad3) Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:09.792153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:09.793082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e38bb60f-8b74-4bda-a747-53e88d2e06a8 could not be found. Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 21:34:09.794022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e38bb60f-8b74-4bda-a747-53e88d2e06a8 could not be found. Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e38bb60f-8b74-4bda-a747-53e88d2e06a8 could not be found. Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4a29573c-1b2c-4f55-8926-6de746cc4719 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Returning 404 to user: Snapshot e38bb60f-8b74-4bda-a747-53e88d2e06a8 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:09.794991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4a29573c-1b2c-4f55-8926-6de746cc4719 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8" status: 404 len: 111 microversion: 2.1 time: 0.050194 Aug 29 21:34:09.795658 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:34:09 2022] GET /compute/v2.1/os-snapshots/e38bb60f-8b74-4bda-a747-53e88d2e06a8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:09.801145 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a0dd9acc-ba96-4dd7-acb0-6a11e2036598 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a20af0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:10.001740 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a0dd9acc-ba96-4dd7-acb0-6a11e2036598 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a" status: 202 len: 0 microversion: 2.1 time: 0.204373 Aug 29 21:34:10.002272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:34:09 2022] DELETE /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:34:10.012469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-91fddfba-8166-459d-8549-d251845180d6 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5404275790>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:10.163241 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-91fddfba-8166-459d-8549-d251845180d6 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a" status: 200 len: 344 microversion: 2.1 time: 0.155662 Aug 29 21:34:10.163818 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:10 2022] GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a => generated 344 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:11.178706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e257a088-5b35-4775-ae61-fdab0ee01490 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403a363a0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:11.289476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-e257a088-5b35-4775-ae61-fdab0ee01490 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] HTTP exception thrown: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e257a088-5b35-4775-ae61-fdab0ee01490 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Request method failure captured: Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a HTTP/1.1 Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDHMR1lK4Wiuv7yEryU9o7P-SYQCyY_K_SSfJOxaWftzKLCa25xYQX0xWCfKpSo521j_5GTcOkErcFnHpWecDJ5zOc81dnbzCgDhfWdqE8xMdbSbIAV9E-XaGCpxK2vX120H8-u84OTiD82AhYEOm4ij34uhBYWioVE5nIoi4YPCug Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:34:11.293981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_23e5e8ff1d1f45a1a9d1f01889f496b1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 6f1bdcc244f9484f8aca8f5e59839027 Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'd9c4c8ff-52de-43f4-b6ee-1c72c650a31a'} Aug 29 21:34:11.295103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. (HTTP 404) (Request-ID: req-2f9a8fd2-82e0-46a8-98c0-0ffbbb0dfc90) Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.295788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:11.296791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:34:11.298038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e257a088-5b35-4775-ae61-fdab0ee01490 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Returning 404 to user: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e257a088-5b35-4775-ae61-fdab0ee01490 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a" status: 404 len: 109 microversion: 2.1 time: 0.121619 Aug 29 21:34:11.299621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:11 2022] GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:34:11.307038 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1f94a660-11c5-4e43-973f-89a40d5bbdfc tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f5403bff9d0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:11.373683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-1f94a660-11c5-4e43-973f-89a40d5bbdfc tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] HTTP exception thrown: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1f94a660-11c5-4e43-973f-89a40d5bbdfc tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Request method failure captured: Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a HTTP/1.1 Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDHMR1lK4Wiuv7yEryU9o7P-SYQCyY_K_SSfJOxaWftzKLCa25xYQX0xWCfKpSo521j_5GTcOkErcFnHpWecDJ5zOc81dnbzCgDhfWdqE8xMdbSbIAV9E-XaGCpxK2vX120H8-u84OTiD82AhYEOm4ij34uhBYWioVE5nIoi4YPCug Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:34:11.376216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_23e5e8ff1d1f45a1a9d1f01889f496b1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 6f1bdcc244f9484f8aca8f5e59839027 Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'd9c4c8ff-52de-43f4-b6ee-1c72c650a31a'} Aug 29 21:34:11.377297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. (HTTP 404) (Request-ID: req-f249e537-415a-4d96-97bb-a055f7f95ee5) Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.377926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:11.378808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:34:11.379881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1f94a660-11c5-4e43-973f-89a40d5bbdfc tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Returning 404 to user: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1f94a660-11c5-4e43-973f-89a40d5bbdfc tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a" status: 404 len: 109 microversion: 2.1 time: 0.074640 Aug 29 21:34:11.380950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:34:11 2022] DELETE /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:11.386334 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3ac587fb-f336-459a-9049-5554160fec76 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Calling method '.version_select at 0x7f54039bd820>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:11.507976 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-3ac587fb-f336-459a-9049-5554160fec76 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] HTTP exception thrown: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3ac587fb-f336-459a-9049-5554160fec76 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Request method failure captured: Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a HTTP/1.1 Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDHMR1lK4Wiuv7yEryU9o7P-SYQCyY_K_SSfJOxaWftzKLCa25xYQX0xWCfKpSo521j_5GTcOkErcFnHpWecDJ5zOc81dnbzCgDhfWdqE8xMdbSbIAV9E-XaGCpxK2vX120H8-u84OTiD82AhYEOm4ij34uhBYWioVE5nIoi4YPCug Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:34:11.510090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/23e5e8ff1d1f45a1a9d1f01889f496b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_23e5e8ff1d1f45a1a9d1f01889f496b1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 23e5e8ff1d1f45a1a9d1f01889f496b1 Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317041574 Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 6f1bdcc244f9484f8aca8f5e59839027 Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317041574-project Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'd9c4c8ff-52de-43f4-b6ee-1c72c650a31a'} Aug 29 21:34:11.511335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. (HTTP 404) (Request-ID: req-48c70bd0-c69f-41ba-8cc4-ce726ffe007b) Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.512126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:11.518313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:34:11.519313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3ac587fb-f336-459a-9049-5554160fec76 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] Returning 404 to user: Volume d9c4c8ff-52de-43f4-b6ee-1c72c650a31a could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3ac587fb-f336-459a-9049-5554160fec76 tempest-VolumesSnapshotsTestJSON-1317041574 tempest-VolumesSnapshotsTestJSON-1317041574-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a" status: 404 len: 109 microversion: 2.1 time: 0.131370 Aug 29 21:34:11.522006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:11 2022] GET /compute/v2.1/os-volumes/d9c4c8ff-52de-43f4-b6ee-1c72c650a31a => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:18.049828 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-075482ea-22c9-49ef-92de-6f069e632b94 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: .version_select at 0x7f5403a18940>, body: {"keypair": {"name": "tempest-keypair-2113280811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnF3bMBfxuLKfCjcZU5F6kp39GCCIs1u5PLS/N+YSt/k9AX1L033jwSBHd3LY2fuTcH62TXHeW+oaAFR+lJGY8ofV8A7pdVloC678aN0SViAbO6gJHhQf26t9bKtm2o6g=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:18.246990 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-075482ea-22c9-49ef-92de-6f069e632b94 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:18.271241 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-075482ea-22c9-49ef-92de-6f069e632b94 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:18.475423 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-075482ea-22c9-49ef-92de-6f069e632b94 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.949667 Aug 29 21:34:18.481477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 9/18] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:34:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:18.894004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1682233835", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:19.179085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] validate_networks() for [('9e04ecf7-e557-4380-9886-ee0044b14438', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:19.870730 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-08e39545-70db-479d-8f4a-2e347e613a3e tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Action: 'create', calling method: .version_select at 0x7f540396adc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1108283374", "metadata": {"Type": "work"}}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-08e39545-70db-479d-8f4a-2e347e613a3e tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Request method failure captured: Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 122 Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDai8RXR7c4s2RsAhsixuqoqgyc0GsGzD0iKN5SDagEVICcaNcjmtz5SoTnkvXw9jxrQSBt8zoabp0yqJM0GAW4oGb8iJSs4MdxAAAWhzQfTFWz9mRMZ2KVEL1f42IANzlxbFBN3toEUxH5ONCI118D7SCEYYgncG5UJyIcKGHISSc Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:34:19.886540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dea2523a77b345aa8d406f725466d9fa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 36d5140e4a064d6bb2510f12f5eaff22 Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1108283374", "metadata": {"Type": "work"}}} Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: Aug 29 21:34:19.888451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1108283374', 'metadata': {'Type': 'work'}}}} Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:19.889188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:34:19.890322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:34:19.891263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:34:19.891263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.894891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-08e39545-70db-479d-8f4a-2e347e613a3e tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:19.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-08e39545-70db-479d-8f4a-2e347e613a3e tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.832243 Aug 29 21:34:19.905748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 10/19] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 21:34:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 839 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 21:34:19.940138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f4b75eed-9a0e-4f9f-9905-95f427bd18f8 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Action: 'create', calling method: .version_select at 0x7f540391eb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1087583614", "metadata": {"Type": "work"}}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f4b75eed-9a0e-4f9f-9905-95f427bd18f8 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Request method failure captured: Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 120 Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDai8RXR7c4s2RsAhsixuqoqgyc0GsGzD0iKN5SDagEVICcaNcjmtz5SoTnkvXw9jxrQSBt8zoabp0yqJM0GAW4oGb8iJSs4MdxAAAWhzQfTFWz9mRMZ2KVEL1f42IANzlxbFBN3toEUxH5ONCI118D7SCEYYgncG5UJyIcKGHISSc Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:34:19.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dea2523a77b345aa8d406f725466d9fa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 36d5140e4a064d6bb2510f12f5eaff22 Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1087583614", "metadata": {"Type": "work"}}} Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: Aug 29 21:34:19.953971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1087583614', 'metadata': {'Type': 'work'}}}} Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi '0' Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:19.954649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:34:19.955732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:34:19.956683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:34:19.956683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:34:19.958884 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f4b75eed-9a0e-4f9f-9905-95f427bd18f8 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:19.960408 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f4b75eed-9a0e-4f9f-9905-95f427bd18f8 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.050479 Aug 29 21:34:19.967537 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 21:34:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:34:20.129154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1756624772", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "networks": [{"uuid": "c25432c1-4cba-4a34-b7c7-24cda229103b"}]}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:20.457689 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] validate_networks() for [('c25432c1-4cba-4a34-b7c7-24cda229103b', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:22.057370 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:22.058066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:22.058257 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:22.058698 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:22.059142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:22.085428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.085926 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.086374 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.100751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.101225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.101723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.196729 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:22.215454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for user 5344cf7b391d44beac2c602ac3e2e64b and project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:22.240449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:22.248159 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:22.408780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4aa02e2f-2a50-48d6-afdc-fa301df6fa30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.623450 Aug 29 21:34:22.411452 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 10/21] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:34:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:22.439556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2914eaf9-826f-470e-abc7-d8d5e87556e1 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Action: 'create', calling method: .version_select at 0x7f54038a9940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-538161180", "metadata": {"Type": "work"}}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2914eaf9-826f-470e-abc7-d8d5e87556e1 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Request method failure captured: Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 118 Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDai8RXR7c4s2RsAhsixuqoqgyc0GsGzD0iKN5SDagEVICcaNcjmtz5SoTnkvXw9jxrQSBt8zoabp0yqJM0GAW4oGb8iJSs4MdxAAAWhzQfTFWz9mRMZ2KVEL1f42IANzlxbFBN3toEUxH5ONCI118D7SCEYYgncG5UJyIcKGHISSc Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:34:22.450238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dea2523a77b345aa8d406f725466d9fa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 36d5140e4a064d6bb2510f12f5eaff22 Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-538161180", "metadata": {"Type": "work"}}} Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: Aug 29 21:34:22.451666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-538161180', 'metadata': {'Type': 'work'}}}} Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi '' Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:22.452469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:34:22.454901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:34:22.456099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:34:22.456099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:22.459301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2914eaf9-826f-470e-abc7-d8d5e87556e1 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:22.465058 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2914eaf9-826f-470e-abc7-d8d5e87556e1 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.037479 Aug 29 21:34:22.465754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 11/22] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 21:34:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:34:22.504617 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b10ca232-1426-4f0a-8c4e-c94159875c60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:22.513567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b10ca232-1426-4f0a-8c4e-c94159875c60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:22.735291 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:22.736397 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:22.737085 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:22.737804 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:22.738468 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:22.764106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.764882 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.765487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.766768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.769810 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.770761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.838421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Getting quotas for project cb5424a2fd9d45c899b4ff8b7869f50e. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:22.846672 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Getting quotas for user b8ac60b941b04b2eb01281ba5f0e0b96 and project cb5424a2fd9d45c899b4ff8b7869f50e. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:22.882637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:22.883426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b10ca232-1426-4f0a-8c4e-c94159875c60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:22.887413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:22.916260 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b10ca232-1426-4f0a-8c4e-c94159875c60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1222 microversion: 2.1 time: 0.449352 Aug 29 21:34:22.922965 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:22 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1222 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:22.942958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-64611787-f805-4e7b-835b-ba115dded29f tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Calling method '.version_select at 0x7f54038a9670>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:23.031238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-26158427-24fc-46e9-998f-caa2631d97e9 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.056842 Aug 29 21:34:23.033022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 12/24] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:34:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:23.047230 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-64611787-f805-4e7b-835b-ba115dded29f tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] HTTP exception thrown: Volume tempest-invalid-863885845 could not be found. Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-64611787-f805-4e7b-835b-ba115dded29f tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Request method failure captured: Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-863885845 HTTP/1.1 Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDai8RXR7c4s2RsAhsixuqoqgyc0GsGzD0iKN5SDagEVICcaNcjmtz5SoTnkvXw9jxrQSBt8zoabp0yqJM0GAW4oGb8iJSs4MdxAAAWhzQfTFWz9mRMZ2KVEL1f42IANzlxbFBN3toEUxH5ONCI118D7SCEYYgncG5UJyIcKGHISSc Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:34:23.052714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dea2523a77b345aa8d406f725466d9fa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 36d5140e4a064d6bb2510f12f5eaff22 Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Volume tempest-invalid-863885845 could not be found. Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'tempest-invalid-863885845'} Aug 29 21:34:23.054009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-863885845 could not be found. (HTTP 404) (Request-ID: req-f5511d8c-72ca-4c66-8e02-a225a5ee26b2) Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.054826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:23.056118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-863885845 could not be found. Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:23.057302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-863885845 could not be found. Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-863885845 could not be found. Aug 29 21:34:23.058938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.063703 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-64611787-f805-4e7b-835b-ba115dded29f tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Returning 404 to user: Volume tempest-invalid-863885845 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:23.067651 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-64611787-f805-4e7b-835b-ba115dded29f tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-863885845" status: 404 len: 98 microversion: 2.1 time: 0.140518 Aug 29 21:34:23.069660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Aug 29 21:34:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-863885845 => generated 98 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:34:23.070763 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7a12fa81-ba9b-4081-be8c-8200c4060b3e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:23.076380 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7a12fa81-ba9b-4081-be8c-8200c4060b3e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:23.085979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-23daae8b-8495-4899-8440-e5d7edbdaa72 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012056 Aug 29 21:34:23.091311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 14/26] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 29 21:34:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 21:34:23.112094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3a705bf0-31ec-4a4e-b99a-dd48f830f0f2 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011551 Aug 29 21:34:23.115468 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 15/27] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 21:34:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 21:34:23.137511 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-31da3804-210d-4f1b-aab0-fa6999ab3726 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Calling method '.version_select at 0x7f5403078af0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:23.264551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7a12fa81-ba9b-4081-be8c-8200c4060b3e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:23.286316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7a12fa81-ba9b-4081-be8c-8200c4060b3e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1215 microversion: 2.1 time: 0.243792 Aug 29 21:34:23.286830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-31da3804-210d-4f1b-aab0-fa6999ab3726 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] HTTP exception thrown: Volume eb8217ad-7786-4fdc-8e48-560b380b43c9 could not be found. Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-31da3804-210d-4f1b-aab0-fa6999ab3726 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Request method failure captured: Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: DELETE /compute/v2.1/os-volumes/eb8217ad-7786-4fdc-8e48-560b380b43c9 HTTP/1.1 Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDai8RXR7c4s2RsAhsixuqoqgyc0GsGzD0iKN5SDagEVICcaNcjmtz5SoTnkvXw9jxrQSBt8zoabp0yqJM0GAW4oGb8iJSs4MdxAAAWhzQfTFWz9mRMZ2KVEL1f42IANzlxbFBN3toEUxH5ONCI118D7SCEYYgncG5UJyIcKGHISSc Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:34:23.288909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dea2523a77b345aa8d406f725466d9fa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 36d5140e4a064d6bb2510f12f5eaff22 Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Volume eb8217ad-7786-4fdc-8e48-560b380b43c9 could not be found. Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'eb8217ad-7786-4fdc-8e48-560b380b43c9'} Aug 29 21:34:23.292540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb8217ad-7786-4fdc-8e48-560b380b43c9 could not be found. (HTTP 404) (Request-ID: req-2cbc1da2-5d5a-4924-96a7-659121238055) Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.293576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:34:23.294745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb8217ad-7786-4fdc-8e48-560b380b43c9 could not be found. Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:34:23.295948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb8217ad-7786-4fdc-8e48-560b380b43c9 could not be found. Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb8217ad-7786-4fdc-8e48-560b380b43c9 could not be found. Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.297144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-31da3804-210d-4f1b-aab0-fa6999ab3726 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Returning 404 to user: Volume eb8217ad-7786-4fdc-8e48-560b380b43c9 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:23.297847 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 13/28] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:23 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:23.297937 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-31da3804-210d-4f1b-aab0-fa6999ab3726 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/eb8217ad-7786-4fdc-8e48-560b380b43c9" status: 404 len: 109 microversion: 2.1 time: 0.170925 Aug 29 21:34:23.297937 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 16/29] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:34:23 2022] DELETE /compute/v2.1/os-volumes/eb8217ad-7786-4fdc-8e48-560b380b43c9 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:23.311857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bba06bb5-6dad-4de6-84dc-ae7dcb41ae64 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Calling method '.version_select at 0x7f5403078e50>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:23.322782 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-915924291", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:23.420573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-bba06bb5-6dad-4de6-84dc-ae7dcb41ae64 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] HTTP exception thrown: Volume 35874de7-235f-442f-b1f9-79766a878752 could not be found. Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bba06bb5-6dad-4de6-84dc-ae7dcb41ae64 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Request method failure captured: Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/os-volumes/35874de7-235f-442f-b1f9-79766a878752 HTTP/1.1 Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDai8RXR7c4s2RsAhsixuqoqgyc0GsGzD0iKN5SDagEVICcaNcjmtz5SoTnkvXw9jxrQSBt8zoabp0yqJM0GAW4oGb8iJSs4MdxAAAWhzQfTFWz9mRMZ2KVEL1f42IANzlxbFBN3toEUxH5ONCI118D7SCEYYgncG5UJyIcKGHISSc Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:34:23.423499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dea2523a77b345aa8d406f725466d9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dea2523a77b345aa8d406f725466d9fa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: dea2523a77b345aa8d406f725466d9fa Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesNegativeTest-574051668 Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 36d5140e4a064d6bb2510f12f5eaff22 Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesNegativeTest-574051668-project Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Volume 35874de7-235f-442f-b1f9-79766a878752 could not be found. Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '35874de7-235f-442f-b1f9-79766a878752'} Aug 29 21:34:23.424687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35874de7-235f-442f-b1f9-79766a878752 could not be found. (HTTP 404) (Request-ID: req-8a5d1e73-4988-4728-9cd9-690a8070f510) Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.425389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:23.426979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35874de7-235f-442f-b1f9-79766a878752 could not be found. Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:34:23.427950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35874de7-235f-442f-b1f9-79766a878752 could not be found. Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35874de7-235f-442f-b1f9-79766a878752 could not be found. Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bba06bb5-6dad-4de6-84dc-ae7dcb41ae64 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] Returning 404 to user: Volume 35874de7-235f-442f-b1f9-79766a878752 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:23.431928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bba06bb5-6dad-4de6-84dc-ae7dcb41ae64 tempest-VolumesNegativeTest-574051668 tempest-VolumesNegativeTest-574051668-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35874de7-235f-442f-b1f9-79766a878752" status: 404 len: 109 microversion: 2.1 time: 0.124820 Aug 29 21:34:23.446585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:23 2022] GET /compute/v2.1/os-volumes/35874de7-235f-442f-b1f9-79766a878752 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:34:23.508564 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] validate_networks() for [('9e04ecf7-e557-4380-9886-ee0044b14438', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:24.784468 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:24.785780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:24.786468 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:24.787050 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:24.787618 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:24.808604 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:24.809112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:24.809556 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:24.810434 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:24.810892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:24.811316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:24.865232 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:24.882552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for user 5344cf7b391d44beac2c602ac3e2e64b and project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:24.919772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:24.924796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:25.106436 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-cb175064-6225-4c8e-9b9c-8594fc45156c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'create', calling method: .version_select at 0x7f54030781f0>, body: {"keypair": {"name": "tempest-keypair-178746993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbgiLRtrbV6GhM+9VQy/UpzyVjts3+8gjqktuSzNKw2UJUqoa6rarnrrTKxJTprI7fmHX30Dt9N3+EXgcEb5T3r+Xyelq6ggr7puvgC10aKT9p1nzqubLyyRkHdVfcWlA=="}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:25.121358 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1d36b3ab-7f2c-4e9a-8c11-ee25843079f2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.829627 Aug 29 21:34:25.136903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 14/31] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:34:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:25.168644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:25.169540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:25.198980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-cb175064-6225-4c8e-9b9c-8594fc45156c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:25.219352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:25.220396 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-cb175064-6225-4c8e-9b9c-8594fc45156c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for user 55a5c6359109440fbb66d985fafc24bf and project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:25.228335 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:25.232830 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:25.233876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:25.234506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:25.235110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:25.329119 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-cb175064-6225-4c8e-9b9c-8594fc45156c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.062192 Aug 29 21:34:25.332892 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 18/32] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 21:34:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1066 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 21:34:25.661772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ce53d6f1-f913-4781-9ceb-af2feb5f5a53 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'create', calling method: .version_select at 0x7f54030785e0>, body: {"keypair": {"name": "tempest-keypair-1141003328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+UIWufMls6kHnRwPCZB+qUbxfMcedkas62uJ8QCM0VHGNceInBLaw4YLamOskRTxY1pG0Zg87ahWk3grvX2yleAInpJ7p3w5f4ZU/qnfO8evFgkYg+w7pL9UMtmbFumQ=="}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:25.706079 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-ce53d6f1-f913-4781-9ceb-af2feb5f5a53 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:25.715859 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-ce53d6f1-f913-4781-9ceb-af2feb5f5a53 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for user 6f0d97b196f44ec985db30f86d4ad3f4 and project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:25.777693 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ce53d6f1-f913-4781-9ceb-af2feb5f5a53 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.443383 Aug 29 21:34:25.778236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 19/33] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:34:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:25.789602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a15d79f7-e199-4bd9-8655-1d7ec199625a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:25.790955 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a15d79f7-e199-4bd9-8655-1d7ec199625a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:26.066908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a15d79f7-e199-4bd9-8655-1d7ec199625a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:26.076548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a15d79f7-e199-4bd9-8655-1d7ec199625a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1221 microversion: 2.1 time: 0.297045 Aug 29 21:34:26.093624 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 20/34] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:25 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1221 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:26.233487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:26.300032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-378b45c7-baaa-4a0d-a32e-35904aa5a46d tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1219 microversion: 2.1 time: 1.161793 Aug 29 21:34:26.304848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 15/35] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:25 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1219 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:26.352103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1683453737", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5edf4d12-91b6-4448-8d9a-6fbab4fee15a"}], "security_groups": [{"name": "tempest-securitygroup--1037484194"}], "key_name": "tempest-keypair-2113280811", "user_data": "}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:26.943346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] validate_networks() for [('5edf4d12-91b6-4448-8d9a-6fbab4fee15a', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:27.108935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:27.109905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:27.127093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.130531 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.131029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:27.131940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.133208 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.137352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:27.626648 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:27.650361 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bdebea64-70cf-4b06-adb3-338215a558d2 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1225 microversion: 2.1 time: 0.546498 Aug 29 21:34:27.651552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 16/36] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:27 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1225 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:27.665703 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:27.666580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:27.679312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.679993 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.686577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:27.687857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.691206 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.695080 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.760908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:28.780173 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-36d283b6-55b8-446e-bdc2-3270fc13ed3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1275 microversion: 2.1 time: 1.120269 Aug 29 21:34:28.810404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:27 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1275 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:28.833975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:28.835217 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:28.880553 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.881154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.882073 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.882360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.882828 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.883254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:29.672340 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:29.700551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-652b339e-207b-43c6-a4f4-60f56fc41572 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1273 microversion: 2.1 time: 0.887858 Aug 29 21:34:29.704869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 18/38] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:28 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1273 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:29.813778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:29.814445 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:29.821590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.822011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.822450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:29.835910 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.836783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.840006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.079978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:32.095827 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dd4ce06d-4d8c-457b-b58e-5645782d8ff2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1273 microversion: 2.1 time: 2.286391 Aug 29 21:34:32.123720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:29 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1273 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:32.139411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:32.141791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:32.151799 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:32.153519 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:32.166590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.168202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.169010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.174714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.177350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.178306 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.848929 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:32.877808 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:32.880765 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:32.881852 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:32.882628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:32.883372 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:32.900001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-fb6b11bd-a1b7-49fd-9b44-2b9c929dcdd4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1279 microversion: 2.1 time: 0.739729 Aug 29 21:34:32.902585 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:32 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1279 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:32.917400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.918205 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.918988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.920007 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.920744 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.921571 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:33.013145 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:33.034820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:33.095525 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:33.111495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:33.127485 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:33.130309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:33.154269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.158172 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.162732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:33.166696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.167529 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.172672 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:33.342274 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4f5e6965-9288-4d78-96cc-26bee43d5b8f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.990036 Aug 29 21:34:33.354021 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:34:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 7007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:33.396603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-802d2fa9-282b-4587-8779-19d7f6e02e28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:33.400100 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-802d2fa9-282b-4587-8779-19d7f6e02e28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:33.655151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:33.675054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0d4337a8-29d9-4abf-8b24-a1fb7091cb2f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1273 microversion: 2.1 time: 0.548489 Aug 29 21:34:33.690779 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:33 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1273 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:33.758150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-802d2fa9-282b-4587-8779-19d7f6e02e28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:33.767564 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-802d2fa9-282b-4587-8779-19d7f6e02e28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1242 microversion: 2.1 time: 0.410099 Aug 29 21:34:33.768219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:33 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1242 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:33.923404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:33.923971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:33.940839 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.943787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.945427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:33.949505 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.952111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.952801 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.718007 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:34.720301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:34.730515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:34.731412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:34.732140 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.733484 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:34.734147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:34.735113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.833016 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:34.917322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=18 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:35.038925 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:35.050890 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-45e4efa0-0562-446a-9e2c-5e981d4d653e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1279 microversion: 2.1 time: 1.131323 Aug 29 21:34:35.072308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 22/44] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:33 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1279 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:35.085264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:35.094705 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:35.132074 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.133607 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.134375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.138306 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.149104 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.150693 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.619527 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:35.637316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6583c9d6-cf1f-4cec-8df6-515cd3d04ed2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1294 microversion: 2.1 time: 0.561093 Aug 29 21:34:35.638132 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 23/45] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:35 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1294 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:35.662341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2050990957", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "514f3495-f14d-42c1-bc82-a600d1b5d3d8"}], "security_groups": [{"name": "tempest-securitygroup--1406284596"}], "key_name": "tempest-keypair-1141003328", "user_data": "}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:36.161749 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:36.201527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6a2e2c64-6c1e-43c0-98e0-11f8c80e2e30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 1.490255 Aug 29 21:34:36.205962 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 23/46] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:34 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:36.228511 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:36.229195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:36.259399 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:36.261092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:36.262490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:36.264188 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:36.265788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:36.267574 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:36.527359 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:36.573495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-af04b1a1-eb35-4eb8-b195-bdc0dc6fc8ca tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1279 microversion: 2.1 time: 0.364804 Aug 29 21:34:36.576153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 24/47] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:36 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1279 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:36.667502 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] validate_networks() for [('514f3495-f14d-42c1-bc82-a600d1b5d3d8', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:36.668409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:36.669078 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:36.679757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:36.680248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:36.705506 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:36.707677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:36.710864 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:36.716097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.251606 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:37.262353 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-874937c9-2ae5-4ec4-b45b-a3a1f9b3abc9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1294 microversion: 2.1 time: 0.595592 Aug 29 21:34:37.262602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:36 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1294 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:37.277433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:37.278066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:37.323814 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.324304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.324890 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.339116 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.339652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.340108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.270408 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:38.288150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3b69ae56-3014-4139-9c6a-bc2bf53ce863 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 1.024520 Aug 29 21:34:38.290093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 26/49] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:37 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:38.304117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:38.305118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:38.316428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.321431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.327432 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.333225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.335155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.337152 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.554608 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:38.585195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a3d791f8-b7c5-483a-aceb-4673c4bac624 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1279 microversion: 2.1 time: 0.293392 Aug 29 21:34:38.589088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 27/50] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:38 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:38.929700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-9aa44b37-ea55-48ee-a026-a9440565a3a1 req-6af8b6c4-ac66-4f50-a5a7-88bc3fbb57eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be0d7ed-dc88-4a71-99f9-3509454cef5a", "tag": "e0d83c82-29bf-4acb-9a84-0daa85948c1b"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:38.960942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-9aa44b37-ea55-48ee-a026-a9440565a3a1 req-6af8b6c4-ac66-4f50-a5a7-88bc3fbb57eb service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.961491 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-9aa44b37-ea55-48ee-a026-a9440565a3a1 req-6af8b6c4-ac66-4f50-a5a7-88bc3fbb57eb service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.961946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-9aa44b37-ea55-48ee-a026-a9440565a3a1 req-6af8b6c4-ac66-4f50-a5a7-88bc3fbb57eb service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.036368 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-9aa44b37-ea55-48ee-a026-a9440565a3a1 req-6af8b6c4-ac66-4f50-a5a7-88bc3fbb57eb service nova] Creating event network-changed:e0d83c82-29bf-4acb-9a84-0daa85948c1b for instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a on hv-cinder-85426 Aug 29 21:34:39.037197 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-9aa44b37-ea55-48ee-a026-a9440565a3a1 req-6af8b6c4-ac66-4f50-a5a7-88bc3fbb57eb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:34:39.041018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-9aa44b37-ea55-48ee-a026-a9440565a3a1 req-6af8b6c4-ac66-4f50-a5a7-88bc3fbb57eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=127217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:34:39.042366 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.047350 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.048014 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.051223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.059405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.059859 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.074388 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.compute.rpcapi [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:34:39.075291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] Releasing lock "compute-rpcapi-router" {{(pid=127217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:34:39.115805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4d16bfa9-8cef-42bf-b944-58153ea07068 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.525031 Aug 29 21:34:39.117042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 28/51] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:39.130460 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:39.137349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:39.158176 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.158677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.159114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.160563 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.161052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.161471 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.723407 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:39.724550 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:39.725507 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:39.726318 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:39.727573 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:39.760386 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:39.762704 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.767000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.767739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.770914 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.773178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-56f405fe-53b1-4a9b-b3ae-4c32e5c20e60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1300 microversion: 2.1 time: 0.654703 Aug 29 21:34:39.774167 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.775245 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.780506 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:39 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1300 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:39.798424 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:39.799351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:39.813208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.825305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.826006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.829349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.830513 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.832324 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.904912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:39.933042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for user 6f0d97b196f44ec985db30f86d4ad3f4 and project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:39.989425 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:39.991785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:40.148414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bf668d95-e265-48ee-bab5-54931f5dfd45 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.505903 Aug 29 21:34:40.149140 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 24/53] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:34:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 4510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:40.166611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:40.202704 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:40.250188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.250937 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.261903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:40.263653 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.264747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.265870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:41.965435 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:41.990036 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-dcee5af3-f974-4195-8969-98aafe4d3deb tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 2.206908 Aug 29 21:34:41.997538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 30/54] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:39 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:42.012505 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:42.022757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:42.033920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:42.060393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.061163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.063021 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.065194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.066789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.067942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.339392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:42.359069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e15f8ada-9699-4c44-a3e7-cebc3a990cbb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1290 microversion: 2.1 time: 0.357350 Aug 29 21:34:42.362310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 31/55] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:41 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1290 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:42.372090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1345097372", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbee627c-5d5c-4780-b2d4-43c7e4d208fc"}], "security_groups": [{"name": "tempest-securitygroup--943553338"}], "key_name": "tempest-keypair-178746993", "user_data": "}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:42.375627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:42.427823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a8fbffc0-7be6-4058-8b08-be0a2ab0e5f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 2.266378 Aug 29 21:34:42.434212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 25/56] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:40 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:42.443291 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:42.444119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:42.476696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.482454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.483524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.490813 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.496646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.502768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:43.688629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] validate_networks() for [('bbee627c-5d5c-4780-b2d4-43c7e4d208fc', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:43.767117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=26 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:44.611759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:44.637641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c1a95cba-7a15-4024-bee4-1f39e0bd7d70 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 2.185612 Aug 29 21:34:44.638667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 26/57] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:42 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:44.643502 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:44.644174 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:44.662530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.662724 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.663681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.666603 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.667314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.668000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.327336 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:45.337217 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0c2a6fae-72c9-43af-8bed-bf26db88bf59 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.697399 Aug 29 21:34:45.337882 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 27/58] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:44 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:45.343032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:45.343741 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:45.349668 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.350429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.350959 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.351893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.352348 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.352886 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.490996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:45.509154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e5a20c52-c5bc-4c86-bf54-e83284c6ac82 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1296 microversion: 2.1 time: 0.165173 Aug 29 21:34:45.510403 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:45 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:45.521044 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:45.521897 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:45.534854 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.536347 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.538386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.540985 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.541845 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.543162 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.971428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:45.971949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:45.972768 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:45.973277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:45.973950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:45.983402 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.984341 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.985005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.986049 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.986696 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.987318 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.002282 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.011029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d9df0546-0524-43e4-91cf-bd3c678249da tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.499226 Aug 29 21:34:46.011860 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:46.012636 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 29/60] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:45 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:46.018498 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-f1b35754-2f8e-410a-9183-029018608739 req-6f0f2ba5-63db-4ab0-ae48-77633f9f01a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57", "tag": "2585b07b-9d0b-4988-b1c6-a7489aea0806"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:46.028538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for user 55a5c6359109440fbb66d985fafc24bf and project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:46.031774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1b35754-2f8e-410a-9183-029018608739 req-6f0f2ba5-63db-4ab0-ae48-77633f9f01a6 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.032370 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1b35754-2f8e-410a-9183-029018608739 req-6f0f2ba5-63db-4ab0-ae48-77633f9f01a6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.032853 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1b35754-2f8e-410a-9183-029018608739 req-6f0f2ba5-63db-4ab0-ae48-77633f9f01a6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.043108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:46.046105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:46.054110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-f1b35754-2f8e-410a-9183-029018608739 req-6f0f2ba5-63db-4ab0-ae48-77633f9f01a6 service nova] Creating event network-changed:2585b07b-9d0b-4988-b1c6-a7489aea0806 for instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 on hv-cinder-85426 Aug 29 21:34:46.054871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1b35754-2f8e-410a-9183-029018608739 req-6f0f2ba5-63db-4ab0-ae48-77633f9f01a6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:34:46.055418 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1b35754-2f8e-410a-9183-029018608739 req-6f0f2ba5-63db-4ab0-ae48-77633f9f01a6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:34:46.056681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.057338 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.057959 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.058856 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.059561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.059987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.070862 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.compute.rpcapi [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:34:46.071766 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] Releasing lock "compute-rpcapi-router" {{(pid=127216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:34:46.090108 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c9058e5e-c6b8-46b0-a148-e8cc9c55dd4b None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075620 Aug 29 21:34:46.091159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 30/61] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:46.109715 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-474e1457-5528-4732-bbdd-666d034aedcd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.744292 Aug 29 21:34:46.110481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 32/62] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 21:34:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 3747 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 21:34:46.116277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:46.117905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:46.127614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.136838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.137619 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.139074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.139771 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.140312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.325069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.338212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-142fc1b1-aafa-4315-89cd-ee0910e920b2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 0.226109 Aug 29 21:34:46.339274 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:46 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:46.347621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6fad0c00-7f22-4999-9611-141ed09fe601 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:46.348228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6fad0c00-7f22-4999-9611-141ed09fe601 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:46.390360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-a1181572-ae2b-463f-a859-a001097bc777 req-0f75d001-1f4f-430b-9aea-75bb055ffbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a336f0-c39c-4472-8b3d-c078b8d0624e", "tag": "320280db-b878-4458-b2ef-75042231b950"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:46.411218 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6fad0c00-7f22-4999-9611-141ed09fe601 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.413869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a1181572-ae2b-463f-a859-a001097bc777 req-0f75d001-1f4f-430b-9aea-75bb055ffbdd service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.414351 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a1181572-ae2b-463f-a859-a001097bc777 req-0f75d001-1f4f-430b-9aea-75bb055ffbdd service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.416920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a1181572-ae2b-463f-a859-a001097bc777 req-0f75d001-1f4f-430b-9aea-75bb055ffbdd service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.421789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6fad0c00-7f22-4999-9611-141ed09fe601 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.423288 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6fad0c00-7f22-4999-9611-141ed09fe601 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.424618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6fad0c00-7f22-4999-9611-141ed09fe601 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1281 microversion: 2.20 time: 0.084383 Aug 29 21:34:46.425902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 34/64] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:46 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:46.431206 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:46.432213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:46.438855 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.439775 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.440655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.442247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.443210 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.444224 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.451877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-a1181572-ae2b-463f-a859-a001097bc777 req-0f75d001-1f4f-430b-9aea-75bb055ffbdd service nova] Creating event network-changed:320280db-b878-4458-b2ef-75042231b950 for instance d1a336f0-c39c-4472-8b3d-c078b8d0624e on hv-cinder-85426 Aug 29 21:34:46.462499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-a1181572-ae2b-463f-a859-a001097bc777 req-0f75d001-1f4f-430b-9aea-75bb055ffbdd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369435 Aug 29 21:34:46.463504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 31/65] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:46.536056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:46.536807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:46.539939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:46.545115 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.545974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.546713 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.547696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.548694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.549329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.618231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=100 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:46.828651 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.839216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2c061bc6-e2cc-4cd9-b77d-52e78b059389 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1296 microversion: 2.1 time: 0.311140 Aug 29 21:34:46.848634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:46 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1296 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:47.035685 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:47.037129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:47.047368 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.047871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.048301 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:47.049048 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.049508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.050038 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:47.064960 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:47.091020 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-364dfc67-d6de-4522-a73f-761d7391b934 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.663627 Aug 29 21:34:47.093048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:46 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:47.361041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:47.361854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:47.374156 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.375821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.380177 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:47.383462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.384235 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.387916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.352630 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:48.367179 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f88c4175-f5d4-47c6-95db-959e37f545b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 1.335938 Aug 29 21:34:48.369785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:48.385006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9c2725cf-a27e-4f99-b351-4468176319e8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 1.029161 Aug 29 21:34:48.386497 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 36/69] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:47 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:48.386609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 33/69] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:47 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:48.391863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:48.393009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:48.393525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:48.396262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:48.402689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.403526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.404282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.405440 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.405646 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.407954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.408554 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.414745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.415727 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.416783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.417594 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.418233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.557818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:48.570703 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-faad8894-50be-43b2-b9b3-b1c26d8d2bc4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1296 microversion: 2.1 time: 0.182774 Aug 29 21:34:48.574713 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 37/70] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:48 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1296 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:48.581348 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:48.581971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:48.602700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:48.605487 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.606266 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.606971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.608340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.608984 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.609593 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.613952 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:48.617971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:48.618663 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-534a0a34-74e5-4d4b-bf66-dfee110ab5b5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1351 microversion: 2.20 time: 0.230622 Aug 29 21:34:48.619214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 34/71] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:48 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1351 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:48.635425 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-239989f7-0aec-463c-8c3a-8723b1aa0f5a req-a944be5d-90a0-4dcf-9002-53fb86214910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ad160e-81c4-4824-8a34-435c95763317", "tag": "58008d54-7073-4d9c-b3a0-446d9eb287e2"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:48.656999 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-239989f7-0aec-463c-8c3a-8723b1aa0f5a req-a944be5d-90a0-4dcf-9002-53fb86214910 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.658499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-239989f7-0aec-463c-8c3a-8723b1aa0f5a req-a944be5d-90a0-4dcf-9002-53fb86214910 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.660257 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-239989f7-0aec-463c-8c3a-8723b1aa0f5a req-a944be5d-90a0-4dcf-9002-53fb86214910 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.673955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-239989f7-0aec-463c-8c3a-8723b1aa0f5a req-a944be5d-90a0-4dcf-9002-53fb86214910 service nova] Creating event network-changed:58008d54-7073-4d9c-b3a0-446d9eb287e2 for instance 90ad160e-81c4-4824-8a34-435c95763317 on hv-cinder-85426 Aug 29 21:34:48.680103 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-239989f7-0aec-463c-8c3a-8723b1aa0f5a req-a944be5d-90a0-4dcf-9002-53fb86214910 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051848 Aug 29 21:34:48.681480 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 35/72] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:48.891726 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:48.909187 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-df6515fd-b663-4014-b4d3-46aa43ad6bd5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.332723 Aug 29 21:34:48.910507 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 38/73] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:48 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:49.397350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:49.398608 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:49.409889 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:49.411570 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:49.422763 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.422941 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.424560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.427763 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.428337 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.430042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.430863 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.432574 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.433189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.433639 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.436297 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.438005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.968702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:50.096015 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:50.104763 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4a3c316e-b90e-4739-913e-46df124a4777 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 0.699305 Aug 29 21:34:50.110377 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 39/74] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:49 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:50.122275 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:50.122914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:50.135391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.135899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.136346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.137303 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.159009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.159909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.321934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:50.336708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-652686fe-7989-42a3-aee1-94b79ad1e3b1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.948192 Aug 29 21:34:50.350554 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 36/75] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:49 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:50.356912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:50.356912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:50.367039 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.367545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.369768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.370866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.373826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.376490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.129512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:51.154304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-64387691-e050-449e-9bd2-9fe3c061859e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 1.042719 Aug 29 21:34:51.154913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 40/76] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:50 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:51.164213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:51.164878 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:51.182675 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.183175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.183609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.185512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.185976 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.187869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.196493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=100 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:51.534982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:51.562698 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:51.564625 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:51.566478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-68b08d8c-c811-4451-b502-d5834db8feeb tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 1.225042 Aug 29 21:34:51.567405 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 37/77] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:50 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:51.576839 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:51.577825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:51.586337 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.587267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.587940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.588967 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.589653 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.590085 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.968205 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:51.984749 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6d29bb01-43a9-46e6-94bc-35714c02c819 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.827960 Aug 29 21:34:51.986624 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 41/78] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:51 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:51.997434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:52.007457 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:52.023638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.026084 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.026717 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.027577 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.028139 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.028649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.228356 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:52.276311 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-eb0309c3-079a-4a2b-86ea-7ec699c859a1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 0.699899 Aug 29 21:34:52.317741 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 38/79] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:51 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:52.339481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-0679aa2c-7c37-489e-83ec-468b576970b0 req-d2e9d619-7512-4bd1-b436-dac853f6d046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f3dbb7-c3ca-46ab-9903-477493581b37", "tag": "9a89d54f-b4bb-438b-aba7-0e6acacc72c3"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:52.410740 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:52.446217 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-0679aa2c-7c37-489e-83ec-468b576970b0 req-d2e9d619-7512-4bd1-b436-dac853f6d046 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.447107 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-0679aa2c-7c37-489e-83ec-468b576970b0 req-d2e9d619-7512-4bd1-b436-dac853f6d046 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.451576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-0679aa2c-7c37-489e-83ec-468b576970b0 req-d2e9d619-7512-4bd1-b436-dac853f6d046 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.476160 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-cd980adf-35fe-4911-8d22-dfcee199e8de tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.482686 Aug 29 21:34:52.484101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 42/80] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:51 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:52.511326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:52.512830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:52.522827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.524087 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.525149 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.526914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.527634 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.528470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.541381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-0679aa2c-7c37-489e-83ec-468b576970b0 req-d2e9d619-7512-4bd1-b436-dac853f6d046 service nova] Creating event network-changed:9a89d54f-b4bb-438b-aba7-0e6acacc72c3 for instance f3f3dbb7-c3ca-46ab-9903-477493581b37 on hv-cinder-85426 Aug 29 21:34:52.573771 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-0679aa2c-7c37-489e-83ec-468b576970b0 req-d2e9d619-7512-4bd1-b436-dac853f6d046 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253345 Aug 29 21:34:52.576953 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 39/81] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:52.588075 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-c86c097b-ebb8-4789-9bc2-3430836d4e72 req-586e2064-8d01-4409-a0f6-489d9d86fc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3846b1-ac29-4006-89ea-bcd7a6c82b2d", "tag": "b456e2d3-818e-4eae-971c-1b0f5b3baa83"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:52.609165 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-c86c097b-ebb8-4789-9bc2-3430836d4e72 req-586e2064-8d01-4409-a0f6-489d9d86fc7f service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.610340 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-c86c097b-ebb8-4789-9bc2-3430836d4e72 req-586e2064-8d01-4409-a0f6-489d9d86fc7f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.611113 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-c86c097b-ebb8-4789-9bc2-3430836d4e72 req-586e2064-8d01-4409-a0f6-489d9d86fc7f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.662152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-c86c097b-ebb8-4789-9bc2-3430836d4e72 req-586e2064-8d01-4409-a0f6-489d9d86fc7f service nova] Creating event network-changed:b456e2d3-818e-4eae-971c-1b0f5b3baa83 for instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d on hv-cinder-85426 Aug 29 21:34:52.682056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-c86c097b-ebb8-4789-9bc2-3430836d4e72 req-586e2064-8d01-4409-a0f6-489d9d86fc7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102552 Aug 29 21:34:52.683738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 40/82] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:52.694779 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:52.697996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:52.711851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.713053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.714550 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.716199 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.717160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.718170 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.810956 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:52.835343 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5b8ec5ab-f68a-4c2b-84fb-dc70562668a6 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.348692 Aug 29 21:34:52.837195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 43/83] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:52 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:53.234196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:53.249061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:53.252435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:53.254315 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2bc01d9c-288d-437d-abb2-347d7c513e80 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 0.568468 Aug 29 21:34:53.266321 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 41/84] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:52 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:53.278669 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:53.280061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:53.295775 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.296996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.298178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:53.299344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.302277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.303461 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:53.346070 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-09785e6d-a1ca-4468-a2fb-da5c9ac33dc1 req-fb465ce6-863e-4412-a21b-d6da449a2a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57", "name": "network-vif-plugged", "status": "completed", "tag": "2585b07b-9d0b-4988-b1c6-a7489aea0806"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:53.356197 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-09785e6d-a1ca-4468-a2fb-da5c9ac33dc1 req-fb465ce6-863e-4412-a21b-d6da449a2a55 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.356949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-09785e6d-a1ca-4468-a2fb-da5c9ac33dc1 req-fb465ce6-863e-4412-a21b-d6da449a2a55 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.357526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-09785e6d-a1ca-4468-a2fb-da5c9ac33dc1 req-fb465ce6-863e-4412-a21b-d6da449a2a55 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:53.375748 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-09785e6d-a1ca-4468-a2fb-da5c9ac33dc1 req-fb465ce6-863e-4412-a21b-d6da449a2a55 service nova] Creating event network-vif-plugged:2585b07b-9d0b-4988-b1c6-a7489aea0806 for instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 on hv-cinder-85426 Aug 29 21:34:53.395453 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-09785e6d-a1ca-4468-a2fb-da5c9ac33dc1 req-fb465ce6-863e-4412-a21b-d6da449a2a55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407012 Aug 29 21:34:53.396240 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 44/85] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:53.418162 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:53.419020 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:53.426961 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.428358 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.429704 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:53.430842 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.432083 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.432975 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:54.213350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:54.239090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b4de01bd-28c5-43b2-ad7e-468317fa25ef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.969835 Aug 29 21:34:54.256115 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:53 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:54.274575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:54.278637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:54.292236 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:54.292710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:54.294734 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:54.296870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:54.298353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:54.299151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:54.459279 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:54.471664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-03fd2956-5389-4971-99a0-84628abb0144 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 1.073694 Aug 29 21:34:54.473327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 45/87] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:53 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:54.494282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:54.495727 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:54.508252 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:54.508880 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:54.513088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:54.516991 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:54.517574 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:54.520234 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:54.929736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:54.942535 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-11765c99-9e54-4429-9900-88246c6410b9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.684835 Aug 29 21:34:54.943117 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 43/88] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:54 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:54.954954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:54.955579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:54.973758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:54.974520 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:54.979411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:54.980230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:54.980747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:54.981791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.191175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:55.209128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a7a87b50-8863-4756-9c64-4895f55ce9c4 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.734382 Aug 29 21:34:55.210618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 46/89] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:54 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:55.280229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:55.280229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:55.288973 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.289405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.289921 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.290840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.291355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.291776 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.588901 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:55.601283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:55.604505 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:55.605691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-803cd585-bb7f-44d1-9884-df18d45379bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 0.656225 Aug 29 21:34:55.606253 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 44/90] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:54 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:55.622522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-e69bc457-18c1-4eca-b3fe-9317ef88226c req-6cac349c-161a-4092-b120-c5eb12af3a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be0d7ed-dc88-4a71-99f9-3509454cef5a", "name": "network-vif-plugged", "status": "completed", "tag": "e0d83c82-29bf-4acb-9a84-0daa85948c1b"}, {"server_uuid": "d1a336f0-c39c-4472-8b3d-c078b8d0624e", "name": "network-vif-plugged", "status": "completed", "tag": "320280db-b878-4458-b2ef-75042231b950"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:55.654073 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-e69bc457-18c1-4eca-b3fe-9317ef88226c req-6cac349c-161a-4092-b120-c5eb12af3a4e service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.656732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-e69bc457-18c1-4eca-b3fe-9317ef88226c req-6cac349c-161a-4092-b120-c5eb12af3a4e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.664724 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-e69bc457-18c1-4eca-b3fe-9317ef88226c req-6cac349c-161a-4092-b120-c5eb12af3a4e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.683176 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-e69bc457-18c1-4eca-b3fe-9317ef88226c req-6cac349c-161a-4092-b120-c5eb12af3a4e service nova] Creating event network-vif-plugged:e0d83c82-29bf-4acb-9a84-0daa85948c1b for instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a on hv-cinder-85426 Aug 29 21:34:55.683176 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-e69bc457-18c1-4eca-b3fe-9317ef88226c req-6cac349c-161a-4092-b120-c5eb12af3a4e service nova] Creating event network-vif-plugged:320280db-b878-4458-b2ef-75042231b950 for instance d1a336f0-c39c-4472-8b3d-c078b8d0624e on hv-cinder-85426 Aug 29 21:34:55.690769 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-e69bc457-18c1-4eca-b3fe-9317ef88226c req-6cac349c-161a-4092-b120-c5eb12af3a4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082579 Aug 29 21:34:55.691906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 45/91] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:55.695133 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:55.699547 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:55.700473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:55.705330 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-028e4f92-9efd-4246-b4a9-084e863a17df tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.429405 Aug 29 21:34:55.707283 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 47/92] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:55 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:55.725778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.726352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.726799 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.727663 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.728143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.728626 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.958122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:55.963429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:55.964036 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:55.973288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-439e1144-8584-4763-b53a-bf5356f88cfd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 0.279800 Aug 29 21:34:55.980726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 46/93] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:55 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:55.981032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.981760 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.982474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.983344 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.983951 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.984512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:56.007038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:56.169342 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:56.188810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-47c2f91c-b087-4405-b5e4-e5de740376f7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.228173 Aug 29 21:34:56.193024 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 48/94] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:55 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:56.235059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:56.235855 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:56.240356 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:56.256697 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:56.260214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:56.267528 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:56.268608 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:56.269217 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:56.270026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:56.535320 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:56.560524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e82f5563-04ca-4856-bdff-1480022bb4fd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.330496 Aug 29 21:34:56.561432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 47/95] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:56 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:56.631019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:56.631414 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:56.634141 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=8 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:56.641015 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:56.641567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:56.642775 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:56.643876 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:56.644514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:56.645367 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:56.729749 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:56.730348 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:56.740094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:56.741306 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:56.741979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:56.742819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:56.743565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:56.744119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:56.860256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:56.878557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:56.882786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:56.885786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8125be36-3895-4afb-b0a8-2520b252b483 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 0.259127 Aug 29 21:34:56.886362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 49/96] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:56 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:57.002646 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:57.004441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:57.017982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.019422 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.021086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.024420 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.025188 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.026019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.415350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:57.440130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4fea6ef9-bb9d-4121-9968-a843a39e9f31 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.712252 Aug 29 21:34:57.440130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 48/97] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:56 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:57.454912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:57.456381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:57.463669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:57.466445 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.467426 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.468200 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.469307 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.469916 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.470488 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.479514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-75b67723-c1cc-41df-b276-837b6254a664 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1368 microversion: 2.1 time: 0.481493 Aug 29 21:34:57.496891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 50/98] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:56 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1368 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:57.584735 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:57.585751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:57.594378 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.595204 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.595795 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.596803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.597570 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.598321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.748365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:57.760909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f5313bda-5eac-4bb2-99f9-3e207d4c1a9f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.318947 Aug 29 21:34:57.761506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:57 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:57.773931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-7b961648-8b5f-420c-a543-d7ab4c15560d req-59e81f86-0424-4587-ba51-d8bb45815b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ad160e-81c4-4824-8a34-435c95763317", "name": "network-vif-plugged", "status": "completed", "tag": "58008d54-7073-4d9c-b3a0-446d9eb287e2"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:57.784953 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-7b961648-8b5f-420c-a543-d7ab4c15560d req-59e81f86-0424-4587-ba51-d8bb45815b65 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.785763 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-7b961648-8b5f-420c-a543-d7ab4c15560d req-59e81f86-0424-4587-ba51-d8bb45815b65 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.786323 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-7b961648-8b5f-420c-a543-d7ab4c15560d req-59e81f86-0424-4587-ba51-d8bb45815b65 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.800323 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-7b961648-8b5f-420c-a543-d7ab4c15560d req-59e81f86-0424-4587-ba51-d8bb45815b65 service nova] Creating event network-vif-plugged:58008d54-7073-4d9c-b3a0-446d9eb287e2 for instance 90ad160e-81c4-4824-8a34-435c95763317 on hv-cinder-85426 Aug 29 21:34:57.810775 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-7b961648-8b5f-420c-a543-d7ab4c15560d req-59e81f86-0424-4587-ba51-d8bb45815b65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040233 Aug 29 21:34:57.812663 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 50/100] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:57.923356 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:57.924153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:57.949531 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.952728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.955638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.959342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.960897 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.962699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.975262 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:57.999948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-fc6a5cb4-6494-412c-8e8b-4117a69dcc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.417488 Aug 29 21:34:58.001764 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 51/101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:57 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:58.214154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:58.232718 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:58.234484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:58.235840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-95926de0-70a7-4d14-b882-4e157eff085f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 0.327035 Aug 29 21:34:58.237166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 51/102] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:57 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:58.475406 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:58.478733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:58.493745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.495366 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.495834 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.497131 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.497608 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.498038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.508055 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:58.509381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:58.522213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.523137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.523685 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.524540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.525834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.526365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.556677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=100 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:58.752338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:58.764556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0ce2f10b-cfca-4371-aa0c-cb70525563cd tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1315 microversion: 2.1 time: 0.302629 Aug 29 21:34:58.767737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 52/103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:58 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:58.788871 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:58.789567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:58.796719 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.800063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.802603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.803384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.803858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.804287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.816503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:58.827333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1e54e20c-df29-4b39-9ba1-c74c5d8e3824 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1558 microversion: 2.1 time: 0.324898 Aug 29 21:34:58.827735 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 52/104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:58 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1558 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:58.850254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:58.850743 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:58.858113 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.858899 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.859330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.860037 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.860486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.860931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.125684 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5d17707c-389c-49f0-aee6-0cff1b687503 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.279593 Aug 29 21:34:59.134717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 53/105] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:34:58 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-interface => generated 284 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:59.139764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:59.140618 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:59.147876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.148905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.149506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.151977 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.152653 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.153228 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.244631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:59.255725 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ef2e0297-0461-4c70-a444-ba1ea0b0015f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.476309 Aug 29 21:34:59.258982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 53/106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:58 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:59.269154 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:59.271862 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:59.283113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.283938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.284520 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.285766 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.286376 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.287097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.614117 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:59.618765 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:59.626429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-72ea1585-1811-4e05-95ce-c3273b1830e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.490010 Aug 29 21:34:59.628496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:59.629202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:59 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:59.631013 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:59.635910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-fa55929b-239d-427f-a9ba-35c4ef8c1f47 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 0.375079 Aug 29 21:34:59.636500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 54/108] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:34:59 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:34:59.792433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:59.793010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:59.801330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.801832 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.802270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.802982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.803444 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.803871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.840965 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-86547e61-aa4e-44b4-9970-5ed4c9aa1535 req-abec1f7e-2b1d-4fda-9385-d76c84e35590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f3dbb7-c3ca-46ab-9903-477493581b37", "name": "network-vif-plugged", "status": "completed", "tag": "9a89d54f-b4bb-438b-aba7-0e6acacc72c3"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:59.856675 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-86547e61-aa4e-44b4-9970-5ed4c9aa1535 req-abec1f7e-2b1d-4fda-9385-d76c84e35590 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.857168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-86547e61-aa4e-44b4-9970-5ed4c9aa1535 req-abec1f7e-2b1d-4fda-9385-d76c84e35590 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.857638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-86547e61-aa4e-44b4-9970-5ed4c9aa1535 req-abec1f7e-2b1d-4fda-9385-d76c84e35590 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.891474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-86547e61-aa4e-44b4-9970-5ed4c9aa1535 req-abec1f7e-2b1d-4fda-9385-d76c84e35590 service nova] Creating event network-vif-plugged:9a89d54f-b4bb-438b-aba7-0e6acacc72c3 for instance f3f3dbb7-c3ca-46ab-9903-477493581b37 on hv-cinder-85426 Aug 29 21:34:59.909462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-86547e61-aa4e-44b4-9970-5ed4c9aa1535 req-abec1f7e-2b1d-4fda-9385-d76c84e35590 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072142 Aug 29 21:34:59.910421 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 55/109] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:00.083955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:00.098134 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bd319478-c3d6-4df1-a330-8a38017f4add tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1502 microversion: 2.1 time: 0.311265 Aug 29 21:35:00.101029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 55/110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:59 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:00.279911 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:00.282157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:00.290757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.291247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.291677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:00.292461 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.292987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.298856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:00.526312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:00.544523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b30f05d4-9b8a-408e-b6a3-d1101f0421d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1321 microversion: 2.1 time: 0.269774 Aug 29 21:35:00.559309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 56/111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:00 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:00.660203 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:00.661465 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:00.667205 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:00.668138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:00.689957 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.692762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.695544 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.696367 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:00.699124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.701817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.704005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:00.707459 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.707907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.709032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:00.712669 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.717250 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.214216 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:01.225074 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:01.225702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:01.227469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:01.229080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3d810724-3ffc-4a1d-9b40-f283efbdb9a2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 0.565860 Aug 29 21:35:01.238116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4ecb3966-7768-450c-946d-e2c994f64c51 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.582575 Aug 29 21:35:01.245830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 57/112] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:00 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:01.261002 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 56/113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:00 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:01.300247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-2d54f264-aae6-4abf-81d2-d25f6e06d429 req-876601fe-f2ea-4fe6-a1bc-dda5f58c3330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57", "tag": "2585b07b-9d0b-4988-b1c6-a7489aea0806"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:01.317176 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-2d54f264-aae6-4abf-81d2-d25f6e06d429 req-876601fe-f2ea-4fe6-a1bc-dda5f58c3330 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.318079 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-2d54f264-aae6-4abf-81d2-d25f6e06d429 req-876601fe-f2ea-4fe6-a1bc-dda5f58c3330 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.318714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-2d54f264-aae6-4abf-81d2-d25f6e06d429 req-876601fe-f2ea-4fe6-a1bc-dda5f58c3330 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.337169 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-2d54f264-aae6-4abf-81d2-d25f6e06d429 req-876601fe-f2ea-4fe6-a1bc-dda5f58c3330 service nova] Creating event network-changed:2585b07b-9d0b-4988-b1c6-a7489aea0806 for instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 on hv-cinder-85426 Aug 29 21:35:01.343608 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-2d54f264-aae6-4abf-81d2-d25f6e06d429 req-876601fe-f2ea-4fe6-a1bc-dda5f58c3330 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048056 Aug 29 21:35:01.349231 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 58/114] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:01.581841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:01.583069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:01.594005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.594714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.595557 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.596603 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.597901 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.599199 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.766757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b7dac79-0f7c-4459-998d-dd5a40475fee"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:01.770270 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:01.779583 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.781021 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.781938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.782853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.783513 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.784702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.988256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=100 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:02.183033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:02.195389 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-aaabb0be-8765-44aa-bb71-191471876945 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1514 microversion: 2.1 time: 0.626280 Aug 29 21:35:02.201542 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 57/115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:01 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1514 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:02.219751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:02.222742 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:02.247754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.248406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.248711 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:02.249489 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.250146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.250840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:02.305547 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lazy-loading 'flavor' on Instance uuid 90ad160e-81c4-4824-8a34-435c95763317 {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:35:02.543978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9b77f523-a0be-4cf2-a036-7671787bfbaa tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317/action" status: 200 len: 32 microversion: 2.1 time: 0.328997 Aug 29 21:35:02.544524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 58/116] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:35:02 2022] POST /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317/action => generated 32 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:35:02.560326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:02.561231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:02.581758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.583641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.585534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:02.587316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.588384 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.599954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:02.753328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7136bf2f-bd25-45ae-830c-9295a1b56af2 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "POST /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991578 Aug 29 21:35:02.754264 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 59/117] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:35:01 2022] POST /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:02.759657 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:02.760570 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:02.770768 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.771495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.772237 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:02.773279 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.773918 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.774495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:03.026385 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:03.037643 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:03.039929 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:03.042214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c11ec67f-d211-4ae2-9e6b-2e4c190b4029 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1406 microversion: 2.20 time: 0.493065 Aug 29 21:35:03.052681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 59/118] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:02 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:03.057424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-18e0a053-f161-468b-bfaa-a4abc842648f req-460eb710-0518-42ed-9bf8-40ed9237660c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3846b1-ac29-4006-89ea-bcd7a6c82b2d", "name": "network-vif-plugged", "status": "completed", "tag": "b456e2d3-818e-4eae-971c-1b0f5b3baa83"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:03.074177 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:03.084556 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-18e0a053-f161-468b-bfaa-a4abc842648f req-460eb710-0518-42ed-9bf8-40ed9237660c service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:03.085364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-18e0a053-f161-468b-bfaa-a4abc842648f req-460eb710-0518-42ed-9bf8-40ed9237660c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:03.085976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-18e0a053-f161-468b-bfaa-a4abc842648f req-460eb710-0518-42ed-9bf8-40ed9237660c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:03.090032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9c25247e-3fef-4508-99d7-3ffc22eedfec tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.328583 Aug 29 21:35:03.090725 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 60/119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:02 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:03.102324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-18e0a053-f161-468b-bfaa-a4abc842648f req-460eb710-0518-42ed-9bf8-40ed9237660c service nova] Creating event network-vif-plugged:b456e2d3-818e-4eae-971c-1b0f5b3baa83 for instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d on hv-cinder-85426 Aug 29 21:35:03.102522 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:03.103121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:03.108800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-18e0a053-f161-468b-bfaa-a4abc842648f req-460eb710-0518-42ed-9bf8-40ed9237660c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055977 Aug 29 21:35:03.108990 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 60/120] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:03.118158 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:03.118886 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:03.119329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:03.120672 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:03.121227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:03.121647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:03.685529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:03.696316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b8e16e89-0dab-423f-8911-ee00c7672716 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.604512 Aug 29 21:35:03.700261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:03 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:04.071106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:04.072459 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:04.081186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.082272 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.083004 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.084133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.085238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.085854 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.114690 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:04.115517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:04.125698 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.126192 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.126624 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.127329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.128331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.128792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.481188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:04.490752 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:04.492166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:04.494203 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:04.495816 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d4bc919b-0f6a-4308-a9b1-1e4d6ce1d9b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1598 microversion: 2.20 time: 0.429847 Aug 29 21:35:04.513324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 61/122] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:04 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1598 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:35:04.513495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-588ab62f-476e-4086-88db-83882f413535 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.394471 Aug 29 21:35:04.513495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:04 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:04.519889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:04.520390 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:04.527086 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.527580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.528007 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.529166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.529166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.529583 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.701700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-90b5d433-8e29-4c7e-ba98-5b0ce7646281 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.186338 Aug 29 21:35:04.704781 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 62/124] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 21:35:04 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:35:04.719178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:04.719783 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:04.727998 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.728731 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.729516 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.730420 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:04.731161 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:04.731806 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.974373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:04.984493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6eb7558c-aeda-4e71-9a49-219b48ced61c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.268928 Aug 29 21:35:04.985973 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 63/125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:04 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:05.527908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:05.529331 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:05.538709 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:05.539206 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:05.539888 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:05.540930 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:05.541684 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:05.554131 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:05.862895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:05.875149 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-25ca20c4-d615-41ac-b7e7-150b9d9161c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1364 microversion: 2.1 time: 0.354154 Aug 29 21:35:05.876010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 63/126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:05 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:06.008351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:06.009680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:06.018445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:06.019096 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:06.020107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:06.021002 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:06.022028 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:06.022607 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:06.309001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-76f6a17a-7c9a-4bae-90a2-6c5b0c94faf1 req-9f34b536-3d78-4a60-8254-b49fe96fb2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f3dbb7-c3ca-46ab-9903-477493581b37", "tag": "9a89d54f-b4bb-438b-aba7-0e6acacc72c3"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:06.321119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-76f6a17a-7c9a-4bae-90a2-6c5b0c94faf1 req-9f34b536-3d78-4a60-8254-b49fe96fb2c2 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:06.321980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-76f6a17a-7c9a-4bae-90a2-6c5b0c94faf1 req-9f34b536-3d78-4a60-8254-b49fe96fb2c2 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:06.322624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-76f6a17a-7c9a-4bae-90a2-6c5b0c94faf1 req-9f34b536-3d78-4a60-8254-b49fe96fb2c2 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:06.337281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-76f6a17a-7c9a-4bae-90a2-6c5b0c94faf1 req-9f34b536-3d78-4a60-8254-b49fe96fb2c2 service nova] Creating event network-changed:9a89d54f-b4bb-438b-aba7-0e6acacc72c3 for instance f3f3dbb7-c3ca-46ab-9903-477493581b37 on hv-cinder-85426 Aug 29 21:35:06.343060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-76f6a17a-7c9a-4bae-90a2-6c5b0c94faf1 req-9f34b536-3d78-4a60-8254-b49fe96fb2c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038202 Aug 29 21:35:06.343748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 64/127] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:06.351907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:06.363820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-685a767c-b2d5-408e-abae-6bfc080c156b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.361391 Aug 29 21:35:06.364822 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 64/128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:06 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:06.898316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:06.899008 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:06.911521 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:06.917855 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:06.918401 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:06.919147 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:06.919619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:06.920040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:07.127725 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:07.138526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-069ee5ad-a318-41d4-95dc-1fc7d8e65c15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1550 microversion: 2.1 time: 0.245755 Aug 29 21:35:07.139117 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 65/129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:06 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1550 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:07.162825 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:07.163351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:07.170943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:07.171441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:07.171878 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:07.172573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:07.173054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:07.173476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:07.325272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-df86cd4b-0366-4cb9-bcdd-13dc3dea0a93 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167495 Aug 29 21:35:07.325856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 65/130] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:35:07 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:07.388169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:07.389486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:07.413931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:07.414514 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:07.414960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:07.415697 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:07.416151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:07.416573 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:07.675309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:07.685120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5a63a222-a5e1-41db-a988-fe02f45eae07 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.303088 Aug 29 21:35:07.701689 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 66/131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:07 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:08.720063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:08.721858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:08.731921 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:08.732423 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:08.733052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:08.733663 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:08.734124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:08.734555 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:09.000005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-2f22a70d-d917-4c01-81e7-f45b798a982f req-84d7656a-33a7-43a2-a162-65b55487e013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3846b1-ac29-4006-89ea-bcd7a6c82b2d", "tag": "b456e2d3-818e-4eae-971c-1b0f5b3baa83"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:09.015484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-2f22a70d-d917-4c01-81e7-f45b798a982f req-84d7656a-33a7-43a2-a162-65b55487e013 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:09.016304 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-2f22a70d-d917-4c01-81e7-f45b798a982f req-84d7656a-33a7-43a2-a162-65b55487e013 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:09.016981 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-2f22a70d-d917-4c01-81e7-f45b798a982f req-84d7656a-33a7-43a2-a162-65b55487e013 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:09.033040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-2f22a70d-d917-4c01-81e7-f45b798a982f req-84d7656a-33a7-43a2-a162-65b55487e013 service nova] Creating event network-changed:b456e2d3-818e-4eae-971c-1b0f5b3baa83 for instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d on hv-cinder-85426 Aug 29 21:35:09.039797 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-2f22a70d-d917-4c01-81e7-f45b798a982f req-84d7656a-33a7-43a2-a162-65b55487e013 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043418 Aug 29 21:35:09.041022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 67/132] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:09.339486 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:09.354081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bc398917-9fbd-43a4-beae-c0113ca0cfb1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.638385 Aug 29 21:35:09.354687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 66/133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:08 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:10.382894 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:10.383585 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:10.390089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:10.390588 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:10.391047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:10.391831 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:10.392281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:10.393375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:10.577266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:10.586574 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c0a0a38f-7fff-4d90-a63f-f87597f46468 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.208401 Aug 29 21:35:10.587508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 68/134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:10 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:11.607307 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:11.607942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:11.615900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:11.616383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:11.616854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:11.617609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:11.618057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:11.618482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:11.796077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:11.804869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-64b28008-4d6c-4f02-9da0-62c1bd131c2f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.201059 Aug 29 21:35:11.805464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 67/135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:11 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:12.827445 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:12.833579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:12.848319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:12.848849 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:12.849301 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:12.850023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:12.850480 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:12.854938 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:13.027387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:13.035106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:13.043837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1eea630f-244b-40a8-bb9c-e41ac86f8e81 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.220266 Aug 29 21:35:13.044998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:12 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:13.305514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:13.306155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:13.308441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:13.313658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:13.314080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:13.314509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:13.315792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:13.316242 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:13.316682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:13.345688 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:35:13.437299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-60889900-c063-49fa-959f-cff90906e08e tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 204 len: 0 microversion: 2.1 time: 0.135765 Aug 29 21:35:13.437915 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 68/137] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:35:13 2022] DELETE /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:35:13.446209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:13.446892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:13.458622 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:13.459123 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:13.459554 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:13.460254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:13.460738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:13.461157 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:13.596647 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:13.605770 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7a5550d4-2d21-4fc4-9d16-72662f699d3f tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1554 microversion: 2.1 time: 0.163438 Aug 29 21:35:13.606400 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 70/138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:13 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:14.066409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:14.067117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:14.075056 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:14.075541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:14.075972 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:14.076685 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:14.077137 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:14.077593 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:14.218223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:14.226008 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ad5d3814-440c-4543-9007-5d067e3bdd28 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.164461 Aug 29 21:35:14.226580 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:14 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:14.630167 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:14.630891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:14.637540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:14.639376 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:14.639907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:14.640701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:14.641372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:14.641879 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:14.787078 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:14.795196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ae50cd8e-6951-45eb-8ff5-bb900b838fef tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1554 microversion: 2.1 time: 0.170533 Aug 29 21:35:14.795795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 71/140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:14 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:15.247443 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:15.248094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:15.255501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.255988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.256629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:15.257611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.258105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.258767 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:15.404870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:15.412382 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-44d31f8e-ce7c-407e-ac3c-95c0c933bc6f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.168828 Aug 29 21:35:15.413037 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 70/141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:15 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:15.821441 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:15.822052 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:15.828060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.828541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.828993 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:15.829671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.830135 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.830564 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:15.982984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:15.992100 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a9a0915f-b76d-4e47-94dc-8f29f7e759e6 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1554 microversion: 2.1 time: 0.174259 Aug 29 21:35:15.992697 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 72/142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:15 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:16.435434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:16.436836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:16.445227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:16.446174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:16.446820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:16.448168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:16.448863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:16.449488 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:16.646346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:16.657905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-988ec475-8c01-4e5f-947c-4ec9d641b5e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.227580 Aug 29 21:35:16.659447 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 71/143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:16 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:16.827499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-361b2aeb-66df-4541-9121-199ead4804a7 req-c2d415e8-2111-4bc8-bc6a-8f0b349690b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a336f0-c39c-4472-8b3d-c078b8d0624e", "name": "network-vif-deleted", "tag": "320280db-b878-4458-b2ef-75042231b950"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:16.833353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=81 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:16.855376 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-361b2aeb-66df-4541-9121-199ead4804a7 req-c2d415e8-2111-4bc8-bc6a-8f0b349690b7 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:16.855861 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-361b2aeb-66df-4541-9121-199ead4804a7 req-c2d415e8-2111-4bc8-bc6a-8f0b349690b7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:16.856302 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-361b2aeb-66df-4541-9121-199ead4804a7 req-c2d415e8-2111-4bc8-bc6a-8f0b349690b7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:16.875792 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-361b2aeb-66df-4541-9121-199ead4804a7 req-c2d415e8-2111-4bc8-bc6a-8f0b349690b7 service nova] Creating event network-vif-deleted:320280db-b878-4458-b2ef-75042231b950 for instance d1a336f0-c39c-4472-8b3d-c078b8d0624e on hv-cinder-85426 Aug 29 21:35:16.882746 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-361b2aeb-66df-4541-9121-199ead4804a7 req-c2d415e8-2111-4bc8-bc6a-8f0b349690b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058638 Aug 29 21:35:16.883829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 73/144] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:17.021195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:17.022531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:17.030622 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:17.031312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:17.032045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:17.032934 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:17.033579 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:17.033935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:17.160828 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ac60b941b04b2eb01281ba5f0e0b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5424a2fd9d45c899b4ff8b7869f50e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:17.170884 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ab82be08-ac97-4339-b3f0-a87e32be1a30 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 200 len: 1346 microversion: 2.1 time: 0.160263 Aug 29 21:35:17.171637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 72/145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:17 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 1346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:17.680268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:17.681067 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:17.688971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:17.690118 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:17.690655 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:17.691424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:17.692182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:17.692708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:17.866811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:17.876032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2d9df400-f028-4dbf-b9bb-6ccbefe61121 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.200112 Aug 29 21:35:17.876660 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 74/146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:17 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:18.194253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:18.195639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:18.202210 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.202730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.203167 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.203861 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.204316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.204800 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.221519 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] HTTP exception thrown: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Request method failure captured: Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e HTTP/1.1 Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDboAdQ3UWRkb1tYY8FoiZearqhLGdMHyIMEVAxpgoviChmP0pH2_nm8DJiBlmjo7poENyWNVWv4VKTsZUO_zhbUpf7zoVhv8gF1PovRYrqJIvGvvdTIEHC_zTULtcPnAmh76BxgQwmVh_bM-MHDqtjY1DRy87LZLMaHxcxIE4LEps Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:35:18.226817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb5424a2fd9d45c899b4ff8b7869f50e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: b8ac60b941b04b2eb01281ba5f0e0b96 Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'd1a336f0-c39c-4472-8b3d-c078b8d0624e'} Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:18.229004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.230128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.231256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Returning 404 to user: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:18.231256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f9ab3fb3-138e-41a2-998e-3fbf0e6d8f5a tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 404 len: 111 microversion: 2.1 time: 0.039597 Aug 29 21:35:18.231256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 73/147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:18 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:35:18.355383 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:18.357531 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:18.363633 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.364128 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.364566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.365552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.366008 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.366432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.379974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] HTTP exception thrown: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Request method failure captured: Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e/os-volume_attachments HTTP/1.1 Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDboAdQ3UWRkb1tYY8FoiZearqhLGdMHyIMEVAxpgoviChmP0pH2_nm8DJiBlmjo7poENyWNVWv4VKTsZUO_zhbUpf7zoVhv8gF1PovRYrqJIvGvvdTIEHC_zTULtcPnAmh76BxgQwmVh_bM-MHDqtjY1DRy87LZLMaHxcxIE4LEps Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:35:18.384935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb5424a2fd9d45c899b4ff8b7869f50e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: b8ac60b941b04b2eb01281ba5f0e0b96 Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.386448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'server_id': 'd1a336f0-c39c-4472-8b3d-c078b8d0624e'} Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:18.387267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:18.388602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:18.389896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Returning 404 to user: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:18.389896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7a349b50-9d63-4bfd-be4a-8c756c92e7fe tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035208 Aug 29 21:35:18.389896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 75/148] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:35:18 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:35:18.899196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:18.899859 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:18.905939 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.906440 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.906863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.907540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.907987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.908983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.934973 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:19.059249 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:19.067441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-acca9487-0c32-4c21-b02d-3bf35aa33f5b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.172203 Aug 29 21:35:19.067898 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 74/149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:18 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:19.608059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:19.608656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:19.615590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:19.616339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:19.617058 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:19.617769 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:19.618248 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:19.618857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:19.633978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] HTTP exception thrown: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Request method failure captured: Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e HTTP/1.1 Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDboAdQ3UWRkb1tYY8FoiZearqhLGdMHyIMEVAxpgoviChmP0pH2_nm8DJiBlmjo7poENyWNVWv4VKTsZUO_zhbUpf7zoVhv8gF1PovRYrqJIvGvvdTIEHC_zTULtcPnAmh76BxgQwmVh_bM-MHDqtjY1DRy87LZLMaHxcxIE4LEps Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:35:19.636517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb5424a2fd9d45c899b4ff8b7869f50e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: b8ac60b941b04b2eb01281ba5f0e0b96 Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.637950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'd1a336f0-c39c-4472-8b3d-c078b8d0624e'} Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:19.638597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.639650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.641270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Returning 404 to user: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:19.641270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e49c9831-d2d9-47c1-80a3-04e944f76ae5 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 404 len: 111 microversion: 2.1 time: 0.033878 Aug 29 21:35:19.641270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 76/150] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:35:19 2022] DELETE /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:35:19.649106 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:19.649773 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] [instance: d1a336f0-c39c-4472-8b3d-c078b8d0624e] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:19.656689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:19.657172 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:19.657602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:19.658821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:19.659278 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:19.659700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:19.674167 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] HTTP exception thrown: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Request method failure captured: Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e HTTP/1.1 Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDboAdQ3UWRkb1tYY8FoiZearqhLGdMHyIMEVAxpgoviChmP0pH2_nm8DJiBlmjo7poENyWNVWv4VKTsZUO_zhbUpf7zoVhv8gF1PovRYrqJIvGvvdTIEHC_zTULtcPnAmh76BxgQwmVh_bM-MHDqtjY1DRy87LZLMaHxcxIE4LEps Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:35:19.676092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb5424a2fd9d45c899b4ff8b7869f50e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb5424a2fd9d45c899b4ff8b7869f50e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: cb5424a2fd9d45c899b4ff8b7869f50e Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150656104 Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: b8ac60b941b04b2eb01281ba5f0e0b96 Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-DeleteServersTestJSON-1150656104-project Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.677292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'd1a336f0-c39c-4472-8b3d-c078b8d0624e'} Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:19.677946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. Aug 29 21:35:19.678990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:19.681515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] Returning 404 to user: Instance d1a336f0-c39c-4472-8b3d-c078b8d0624e could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:19.682517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-dc2c65c1-b15e-4d36-be90-f777e07db4e7 tempest-DeleteServersTestJSON-1150656104 tempest-DeleteServersTestJSON-1150656104-project] 10.222.0.20 "GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e" status: 404 len: 111 microversion: 2.1 time: 0.038723 Aug 29 21:35:19.683210 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 75/151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:19 2022] GET /compute/v2.1/servers/d1a336f0-c39c-4472-8b3d-c078b8d0624e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:35:20.089524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:20.090223 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:20.096686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:20.097169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:20.097613 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:20.098307 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:20.098934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:20.099481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:20.350094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:20.360439 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-fefcbf7c-0916-47c4-a15f-0ad25e68719c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.274724 Aug 29 21:35:20.362081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 77/152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:20 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:21.382119 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:21.383735 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:21.391645 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:21.392211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:21.393529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:21.395001 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:21.395702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:21.396226 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:21.647850 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:21.656076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-49a387f4-d400-474d-b240-589613d15f86 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.278175 Aug 29 21:35:21.656683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:21 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:22.679715 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:22.680265 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:22.686830 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:22.687340 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:22.687942 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:22.688980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:22.690271 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:22.690805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:22.931021 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:22.938780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f6d33993-f7a1-4459-a6e6-fd9c9f410d7c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.263105 Aug 29 21:35:22.939370 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:22 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:23.964123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:23.965397 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:23.975578 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:23.976359 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:23.977049 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:23.978180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:23.978839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:23.979461 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:24.333360 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:24.341641 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-faeacdb6-0ff2-412c-9056-8a6e496b5ab8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.381590 Aug 29 21:35:24.342214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:23 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:25.363928 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:25.365313 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:25.376189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:25.377794 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:25.378719 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:25.379975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:25.380650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:25.381451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:25.588187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:25.597647 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3f69ec28-9cf3-4384-9da2-c1a49e497735 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.238053 Aug 29 21:35:25.598775 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:25 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:26.622171 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:26.622994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:26.641143 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:26.641650 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:26.642094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:26.643470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:26.643974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:26.644687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:26.806997 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:26.815730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-78896870-9284-46e2-a296-8c031203f90e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.197665 Aug 29 21:35:26.816316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:26 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:27.393695 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-24395c87-e3a6-459e-bd6b-99dbc2033e74 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d111f0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:27.449939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-24395c87-e3a6-459e-bd6b-99dbc2033e74 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4cea40ce-ba25-44fc-96fc-2055960bf9d5" status: 200 len: 351 microversion: 2.1 time: 0.060409 Aug 29 21:35:27.450551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:35:27 2022] GET /compute/v2.1/os-volumes/4cea40ce-ba25-44fc-96fc-2055960bf9d5 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:27.837454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:27.838088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:27.844679 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:27.845178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:27.845649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:27.846358 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:27.846818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:27.847243 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:27.995935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:28.004010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-37aa0f7a-3731-4b04-b992-749f40d1ac75 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.170506 Aug 29 21:35:28.004608 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 79/159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:27 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:28.815773 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a73eed7f-30ef-4fa8-bee9-a250914799f2 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402e8d5e0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:28.868391 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a73eed7f-30ef-4fa8-bee9-a250914799f2 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/083c1665-c69b-407c-8f7d-a6d65944ac10" status: 200 len: 351 microversion: 2.1 time: 0.056964 Aug 29 21:35:28.869002 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 81/160] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:35:28 2022] GET /compute/v2.1/os-volumes/083c1665-c69b-407c-8f7d-a6d65944ac10 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:29.025163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:29.025778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:29.032745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.033467 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.033902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:29.034598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.035053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.035474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:29.194657 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:29.202502 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5ded5e29-8838-44ed-b14a-dc0a11c21051 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.181101 Aug 29 21:35:29.203079 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:29 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:30.223793 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:30.224406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:30.231347 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:30.231841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:30.232318 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:30.233043 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:30.233497 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:30.233920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:30.362461 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:30.370154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9666d885-5bef-4600-b55e-6a0988cad07f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.150862 Aug 29 21:35:30.370713 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:30 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:31.390135 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:31.390820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:31.397934 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:31.398433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:31.398869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:31.399571 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:31.400035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:31.400462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:31.534502 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:31.542364 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1040bae4-974a-4ea1-b402-745494427e90 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.156171 Aug 29 21:35:31.542942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 81/163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:31 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:32.359979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9e3ab300-0e42-4549-8c8b-dc0438c414d0 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d15940>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.411846 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9e3ab300-0e42-4549-8c8b-dc0438c414d0 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/aacf5861-54c9-468e-a6c4-5ebc9da47eba" status: 200 len: 351 microversion: 2.1 time: 0.055745 Aug 29 21:35:32.412412 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 83/164] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/os-volumes/aacf5861-54c9-468e-a6c4-5ebc9da47eba => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:32.425021 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-45c06fca-5c60-4174-8b8d-00264dd6298c tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d35940>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.513041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-45c06fca-5c60-4174-8b8d-00264dd6298c tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.091913 Aug 29 21:35:32.513747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 82/165] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:32.528830 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4ab45492-8a1f-402b-a998-7e44963a8060 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d15670>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.565913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.566434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:32.573069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:32.573560 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:32.573988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:32.574709 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:32.575164 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:32.575577 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:32.631726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4ab45492-8a1f-402b-a998-7e44963a8060 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.106559 Aug 29 21:35:32.632476 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 84/166] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:32.646491 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-52c6d927-d387-403e-8582-c25a9d5d5973 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d115e0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.740921 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:32.760773 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-52c6d927-d387-403e-8582-c25a9d5d5973 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.119169 Aug 29 21:35:32.761359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 85/167] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:32.764011 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0da213b5-aabe-4355-a541-91d9bdc7c1b6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.202114 Aug 29 21:35:32.767234 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 83/168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:32.776221 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-887fc0e9-2db7-4d36-a510-665d145f39b3 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d11280>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.874260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-887fc0e9-2db7-4d36-a510-665d145f39b3 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101904 Aug 29 21:35:32.874858 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 86/169] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:32.890116 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-46e94cf2-97dd-45d7-b18d-10df16378eae tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402cd5a60>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.989535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-46e94cf2-97dd-45d7-b18d-10df16378eae tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.103660 Aug 29 21:35:32.990502 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 84/170] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:33.004394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7caa08c4-04b1-4095-9ebd-cdaa4d7a40dc tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d34c10>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:33.099647 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7caa08c4-04b1-4095-9ebd-cdaa4d7a40dc tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.096495 Aug 29 21:35:33.099647 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 87/171] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:33.110097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e5c58a52-d1df-486a-870e-3b3554ec67b2 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402e615e0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:33.199663 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e5c58a52-d1df-486a-870e-3b3554ec67b2 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093599 Aug 29 21:35:33.200316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 85/172] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Aug 29 21:35:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:33.213770 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3ffb9b18-a67e-461d-afb9-e764a62ec6f6 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] Calling method '.version_select at 0x7f5402d15310>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:33.327104 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3ffb9b18-a67e-461d-afb9-e764a62ec6f6 tempest-VolumesTestJSON-2519409 tempest-VolumesTestJSON-2519409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.117293 Aug 29 21:35:33.332635 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 88/173] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 21:35:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:33.798212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:33.799417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:33.805845 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:33.806338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:33.806920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:33.807669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:33.808114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:33.808530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:33.943410 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:33.951772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c387bbee-4c84-413b-aba6-05dc8f3b07f0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1520 microversion: 2.1 time: 0.158870 Aug 29 21:35:33.952363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 86/174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:33 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:34.976946 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:34.977548 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:34.983558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.984089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.984515 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:34.985232 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.985684 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.986090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.130749 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:35.138561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8f7ed0f9-acee-4f25-a399-a889985ff437 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1500 microversion: 2.1 time: 0.166152 Aug 29 21:35:35.139137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 89/175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:34 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:35.159790 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:35.160397 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:35.169772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.170306 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.170742 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.171438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.171958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.172363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.313993 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:35.326174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1a430961-c4df-4908-a5b6-87934f3661db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1515 microversion: 2.1 time: 0.170204 Aug 29 21:35:35.326761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 87/176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:35 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:36.745176 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:36.747514 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:36.756504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.757053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.757483 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:36.758177 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.758633 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.759055 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:36.785130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lazy-loading 'flavor' on Instance uuid 6be0d7ed-dc88-4a71-99f9-3509454cef5a {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:35:36.878010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bd8a999d-377d-4bcf-a80f-1e75d70173fc tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a/action" status: 200 len: 32 microversion: 2.1 time: 0.135816 Aug 29 21:35:36.879155 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 90/177] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:35:36 2022] POST /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:35:36.898981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:36.899879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:36.907514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.908730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.909387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:36.910956 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.912007 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.912534 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:37.171574 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:37.181238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c9607f83-7ac2-43d6-88e0-a5581583a730 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.291425 Aug 29 21:35:37.181823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 88/178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:36 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:38.208926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:38.212333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:38.235382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.236281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.237098 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:38.238177 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.238965 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.240534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:38.486094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:38.498414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8777549a-2c0f-4d54-974d-89ac88da1be7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.295377 Aug 29 21:35:38.499178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 91/179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:38 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:39.521058 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:39.522101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:39.529144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.529636 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.530250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.530949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.531765 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.532338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.993670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:40.004494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6b89ee7a-2520-44e0-910c-1cd1cbd6ad84 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.488943 Aug 29 21:35:40.005449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 89/180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:39 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:41.029863 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:41.030986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:41.049471 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:41.051410 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:41.052284 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:41.053285 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:41.055249 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:41.056631 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:41.328979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:41.338621 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ce4321ae-d6df-4bd1-ada8-9ff3b533414b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.315166 Aug 29 21:35:41.339321 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 92/181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:41 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:42.363133 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:42.363930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:42.380708 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.381199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.381813 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:42.382513 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.383128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.383553 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:42.564325 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:42.573288 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4493aea2-eea3-499c-9d7e-821484b88c2d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.215742 Aug 29 21:35:42.574120 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 90/182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:42 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:43.595967 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:43.597335 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:43.604733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:43.605461 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:43.606242 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:43.607288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:43.607962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:43.608733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:43.614084 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:43.827953 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:43.839046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5d023c2c-6e7f-4180-85a2-d1e98f924412 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.248024 Aug 29 21:35:43.853486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 93/183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:43 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:44.873728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:44.877459 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:44.908004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:44.933212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:44.936148 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:44.937028 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:44.945250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:44.946516 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:44.960355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.173093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:45.181683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bd9759e3-d9b1-4d7c-88bc-b1b1bf08eea9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.322806 Aug 29 21:35:45.182780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 91/184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:44 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:46.203467 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:46.204142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:46.217788 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:46.218379 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:46.219023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:46.219986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:46.220677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:46.221272 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:46.446168 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:46.455491 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8d5ac9f2-0127-4ef0-921b-e090bf36dfa7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.255766 Aug 29 21:35:46.459045 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 94/185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:46 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:47.479573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:47.480175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:47.487540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:47.488246 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:47.489052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.490346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:47.491552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:47.492223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.723285 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:47.735259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1db99440-ace9-4d59-891c-072909940ecf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.259269 Aug 29 21:35:47.741845 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 92/186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:47 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:48.241878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-195e30bc-e3b6-4113-9175-443aba701c3e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Action: 'create', calling method: .version_select at 0x7f5402d158b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-796113926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOubpF2A84g8ixbLNTdv4UUpClTtZpBpiz41AxYPN15yITWMtcF4LGHhdHsKSREI7TNkRli5E4nNHRgObrOEimgw9x2RVdrA8uuoNfRGbrTFaxZ4HZfBR2C4og8hW3gIRQ=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:48.247667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=28 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:48.261494 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-195e30bc-e3b6-4113-9175-443aba701c3e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for project 98d4703c6737454291724a5ad15c9cbb. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:48.267512 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-195e30bc-e3b6-4113-9175-443aba701c3e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for user d882c87d5de7497b822ec7b1798d2008 and project 98d4703c6737454291724a5ad15c9cbb. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:48.315592 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-195e30bc-e3b6-4113-9175-443aba701c3e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.292454 Aug 29 21:35:48.317596 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 95/187] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:35:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:48.767165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:48.767727 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:48.774539 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.775035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.775482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:48.776180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.776665 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.777289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:48.949019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:48.967977 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=93 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:48.984379 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-00ebba57-9715-4ba5-b108-f2f17fcf53eb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.219904 Aug 29 21:35:48.988631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 93/188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:48 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:50.006191 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:50.006821 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:50.015545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:50.016133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:50.017081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:50.017823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:50.019187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:50.019634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:50.155175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:50.163551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3b5fe58c-f393-4d52-9bfd-4cf23329fb21 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.161355 Aug 29 21:35:50.164116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 96/189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:50 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:51.185508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:51.186280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:51.198964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:51.204849 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:51.205403 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:51.206165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:51.206637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:51.207077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:51.387208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:51.396066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e6c789e9-12e8-4c25-8fad-d97810fff01a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.214106 Aug 29 21:35:51.396668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 94/190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:51 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:52.417112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:52.417722 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:52.423794 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.424278 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.424748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.425450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.425903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.426329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.567360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:52.575230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-63d10a68-f7d4-4dce-9d94-73cea70439d1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.162072 Aug 29 21:35:52.575882 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 97/191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:52 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:53.597207 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:53.597757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:53.604655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.605149 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.605589 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:53.606288 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.606746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.607174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:53.739446 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:53.747835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-987495dc-d2e8-4188-81a8-e1c8b1b8d99e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.154103 Aug 29 21:35:53.748040 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 95/192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:53 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:54.768529 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:54.769684 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:54.776259 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:54.776803 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:54.777300 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:54.778068 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:54.778609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:54.779115 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:54.929655 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:54.937978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ccdc338d-570e-46c2-ad95-eee88eda8b69 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.173916 Aug 29 21:35:54.938687 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 98/193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:54 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:55.959999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:55.960907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:55.967445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:55.968007 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:55.968631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:55.969621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:55.970212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:55.970922 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:56.101597 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:56.109236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7e9aacf2-0a0b-4e50-88b2-4206b5ba30b4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.153219 Aug 29 21:35:56.109792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 96/194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:55 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:57.131339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:57.131933 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.138688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.139182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.139614 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.140339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.140899 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.141969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.486058 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:57.494997 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-72f86ffa-418b-444d-9661-4b0ca476a98d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1501 microversion: 2.1 time: 0.368119 Aug 29 21:35:57.495562 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 99/195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:57 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1501 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:57.515899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fac1c3b7-19fe-48fe-8cc7-82c81e5646a7"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:57.518388 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.525548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.526034 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.526463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.527812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.528269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.528782 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.555425 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] HTTP exception thrown: Cannot 'attach_volume' instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a while it is in vm_state rescued Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Request method failure captured: Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: POST /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a/os-volume_attachments HTTP/1.1 Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 74 Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZcJayaPMiVvOdb4QlD1aS9Nlrx6Ud6omWvPEIlFcBGr68ocnfX4OqlkiAD4SgTPp40rgWrvvVdXEKuKJV0IyMWnMNUyRa67hjywKRHUH9PKNHVT8hJ4qmm9XZYQ-vQMdzneL75fqS0xSfG_h0RCKaRx3ndFEnNDSuqeAe22J-D5c Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:35:57.557010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57c7abc43eb142d3b36a6d91beee5d10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 5344cf7b391d44beac2c602ac3e2e64b Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {"volumeAttachment": {"volumeId": "fac1c3b7-19fe-48fe-8cc7-82c81e5646a7"}} Aug 29 21:35:57.558596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Cannot 'attach_volume' instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a while it is in vm_state rescued Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'server_id': '6be0d7ed-dc88-4a71-99f9-3509454cef5a', 'body': {'volumeAttachment': {'volumeId': 'fac1c3b7-19fe-48fe-8cc7-82c81e5646a7'}}} Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:57.559531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a while it is in vm_state rescued Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:57.561213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:57.562933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:57.562933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:57.562933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a while it is in vm_state rescued Aug 29 21:35:57.562933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:35:57.562933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Returning 409 to user: Cannot 'attach_volume' instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a while it is in vm_state rescued {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:57.562933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2836ca67-002c-48e1-9884-ae931e145b02 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046478 Aug 29 21:35:57.562933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 97/196] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:35:57 2022] POST /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:35:57.568545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:57.569201 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.575010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.575494 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.575924 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.576638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.577083 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.577505 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.648404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b70c716d-9d2a-4ada-9fa3-c9f6f4e82a1a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a/action" status: 202 len: 0 microversion: 2.1 time: 0.083012 Aug 29 21:35:57.648984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 100/197] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:35:57 2022] POST /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:35:57.657107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:57.657762 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.664033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.664525 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.664999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.665695 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.666157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.666582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.683424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:57.685352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.693152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.693671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.694272 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.695163 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.695623 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.696112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.720290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-68a7a46b-224f-41e7-a9a7-be5e50b54b24 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/ips" status: 200 len: 149 microversion: 2.1 time: 0.041379 Aug 29 21:35:57.721182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 101/198] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:35:57 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:57.925630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:57.936025 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2fe0006a-455e-4548-98be-08fcf631b993 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1509 microversion: 2.1 time: 0.282682 Aug 29 21:35:57.937377 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 98/199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:57 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:58.959891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:58.960508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:58.962540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:58.968193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:58.968698 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:58.969131 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:58.969844 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:58.970298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:58.970720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.114487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:59.122197 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cfd2a561-60e6-4b0d-af5f-c18b67066893 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1509 microversion: 2.1 time: 0.166248 Aug 29 21:35:59.122751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 102/200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:58 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:59.185343 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaf24bed-7ea9-480e-a495-b1ca4c0c076e"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:59.187618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:59.194741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.195256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.196286 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.196930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.197529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.203352 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:00.143118 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:00.144643 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:00.151531 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:00.152233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:00.153152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:00.154089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:00.154547 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:00.155147 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:00.275145 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d880f488-a39b-40b9-8c98-7ab17a83ded8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.093677 Aug 29 21:36:00.276993 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 99/201] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:35:59 2022] POST /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments => generated 194 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:00.340620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:00.349378 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d4a93fa0-425f-4aa9-b01b-258f75f52895 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1509 microversion: 2.1 time: 0.210006 Aug 29 21:36:00.349948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 103/202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:00 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:01.374681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:01.376222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:01.383582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.384303 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.384923 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:01.385798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.386424 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.386862 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:01.557930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:01.565784 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7b55f96e-57d7-47a6-9625-7712a1b54604 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1515 microversion: 2.1 time: 0.195804 Aug 29 21:36:01.566355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 100/203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:01 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:03.046653 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8ecfbed5-b606-4418-93bc-33bb4676c04a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'create', calling method: .version_select at 0x7f5402d6ed30>, body: {"keypair": {"name": "tempest-keypair-379636365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRr5O+hmt13QDoX7J6OYVZYlSXqzaLd/f2mPqgBO5Xc+tkNfGb5WuYeKFZUJAGFX9OLWqxxVh+cWUOBV9HdDZjkAOl68Kc9QC8DCFNr77QaANcpssQm+lWbmwgoCRedkw=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:03.062627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-8ecfbed5-b606-4418-93bc-33bb4676c04a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:03.067266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-8ecfbed5-b606-4418-93bc-33bb4676c04a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for user 5344cf7b391d44beac2c602ac3e2e64b and project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:03.090030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8ecfbed5-b606-4418-93bc-33bb4676c04a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047101 Aug 29 21:36:03.090623 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 104/204] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:36:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:04.823023 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-846574475", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e04ecf7-e557-4380-9886-ee0044b14438"}], "security_groups": [{"name": "tempest-securitygroup--1725249851"}], "key_name": "tempest-keypair-379636365", "user_data": "}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:04.936363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] validate_networks() for [('9e04ecf7-e557-4380-9886-ee0044b14438', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:05.455219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:05.455827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:05.456301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:05.457012 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:05.457426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:05.473631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.474284 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.474776 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.475569 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.476094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.476739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.496553 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:05.500711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Getting quotas for user 5344cf7b391d44beac2c602ac3e2e64b and project 57c7abc43eb142d3b36a6d91beee5d10. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:05.514605 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:05.517066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:05.567778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8d42777c-62b8-4269-8ed7-bb1868494cbd tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.749874 Aug 29 21:36:05.568450 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 101/205] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:05.582269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-18e18918-9444-478f-992b-eb90f822b788 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:05.584510 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-18e18918-9444-478f-992b-eb90f822b788 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:05.646330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-18e18918-9444-478f-992b-eb90f822b788 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:05.654884 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-18e18918-9444-478f-992b-eb90f822b788 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1244 microversion: 2.1 time: 0.078187 Aug 29 21:36:05.660780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 105/206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:05 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:06.682794 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:06.683405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:06.690072 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.690559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.690992 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.691679 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.692134 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.692559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.753925 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:06.761541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b0f57d45-1497-4f83-847f-66760b32de6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1296 microversion: 2.1 time: 0.083133 Aug 29 21:36:06.762108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 102/207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:06 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:07.782890 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:07.783496 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:07.789902 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.790419 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.790858 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.791557 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.792008 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.792430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.854242 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:07.862198 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5b431df5-0570-45cc-8474-f790cd93536e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1296 microversion: 2.1 time: 0.083163 Aug 29 21:36:07.863594 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 106/208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:07 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:08.881760 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:08.882366 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:08.888732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.889218 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.889688 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.890465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.891428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.891857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.955884 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:08.963715 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-45a751a9-8e3e-4ae6-aae0-63702826e428 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1296 microversion: 2.1 time: 0.085774 Aug 29 21:36:08.964289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 103/209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:08 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:09.986296 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:09.986296 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:10.004122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.004653 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.005101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.005817 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.006280 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.006710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.072899 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:10.081098 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2696e2ce-2dff-4385-9c4b-db86be4909e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1296 microversion: 2.1 time: 0.100228 Aug 29 21:36:10.081694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 107/210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:09 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:11.102863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:11.103635 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:11.110731 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.111478 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.112078 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.112814 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.113268 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.113858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.145442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-21d42fc9-28cb-4eda-b031-9ef8d54f800b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: .version_select at 0x7f5402d11b80>, body: {"keypair": {"name": "tempest-keypair-322869661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP4dWkX+0VRWb0XGamTDExLBMo9DxgAkk+ewmlwdjyGa9humH4D7JiP91+XSRrQyfEd8fILI5fGQOQPKJ1y303RnmxOWYoLifBj6JtkITlSFkcSVi0EM0nhm1ojhE2cKQ=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:11.164411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-21d42fc9-28cb-4eda-b031-9ef8d54f800b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:11.173193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-21d42fc9-28cb-4eda-b031-9ef8d54f800b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:11.194278 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:11.197539 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-21d42fc9-28cb-4eda-b031-9ef8d54f800b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057722 Aug 29 21:36:11.198293 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 108/211] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:36:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:11.206988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e74cad2c-8f5a-48ef-b5a6-bb9f39ea4fb6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1302 microversion: 2.1 time: 0.108082 Aug 29 21:36:11.207578 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 104/212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:11 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:11.538884 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:11.539978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:11.553766 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.555269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.555950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.557054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.558827 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.559569 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.598870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-73176441-eeb7-45e9-9446-ebd572e63e4e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/ips" status: 200 len: 151 microversion: 2.20 time: 0.066009 Aug 29 21:36:11.599472 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 109/213] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 29 21:36:11 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:36:12.228915 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:12.229452 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:12.237379 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:12.237874 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:12.238313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.239011 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:12.239469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:12.239894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.375448 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:12.383052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0dd3d2ef-5f3e-469c-87e1-e9e9cd65ca17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.158229 Aug 29 21:36:12.383616 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 105/214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:12 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:12.653922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1110367822", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5edf4d12-91b6-4448-8d9a-6fbab4fee15a"}], "security_groups": [{"name": "tempest-securitygroup--764077097"}], "key_name": "tempest-keypair-322869661", "user_data": "}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:12.755834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] validate_networks() for [('5edf4d12-91b6-4448-8d9a-6fbab4fee15a', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:13.405331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:13.406222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:13.414721 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.415346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.415784 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.416521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.417014 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.417469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.561552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:13.562091 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:13.563575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:13.564183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:13.564761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:13.574389 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.574989 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.575523 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.576393 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.576954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.577454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.595838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:13.600047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:13.612966 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:13.615265 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:13.665766 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c58ba536-cc07-4863-8a50-6e93bfced2a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.016719 Aug 29 21:36:13.667494 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 110/215] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:13.681089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5e5dbe3b-21ed-4969-87db-3577b7960917 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:13.681843 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5e5dbe3b-21ed-4969-87db-3577b7960917 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:13.752376 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5e5dbe3b-21ed-4969-87db-3577b7960917 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:13.760504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5e5dbe3b-21ed-4969-87db-3577b7960917 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1241 microversion: 2.1 time: 0.084565 Aug 29 21:36:13.761783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 111/216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:13 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:13.762181 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:13.774633 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-98cb688c-6662-489e-bbd7-0a826995284c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.373389 Aug 29 21:36:13.775819 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 106/217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:13 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:14.192151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-a244d10b-286d-4148-ab38-678300024818 req-e0adfca6-58e4-4824-8482-74b99f5d5d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446cfebe-c164-4c5b-8312-67dd13da2898", "tag": "d6330450-f0d1-4063-9b9d-1477fa88871b"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:14.201669 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a244d10b-286d-4148-ab38-678300024818 req-e0adfca6-58e4-4824-8482-74b99f5d5d5d service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.202242 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a244d10b-286d-4148-ab38-678300024818 req-e0adfca6-58e4-4824-8482-74b99f5d5d5d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.206119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a244d10b-286d-4148-ab38-678300024818 req-e0adfca6-58e4-4824-8482-74b99f5d5d5d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.217467 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:14.231192 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-a244d10b-286d-4148-ab38-678300024818 req-e0adfca6-58e4-4824-8482-74b99f5d5d5d service nova] Creating event network-changed:d6330450-f0d1-4063-9b9d-1477fa88871b for instance 446cfebe-c164-4c5b-8312-67dd13da2898 on hv-cinder-85426 Aug 29 21:36:14.236825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-a244d10b-286d-4148-ab38-678300024818 req-e0adfca6-58e4-4824-8482-74b99f5d5d5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048933 Aug 29 21:36:14.237610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 112/218] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:14.785348 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:14.786140 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:14.792975 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.793759 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.802126 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:14.802960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:14.806245 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.807118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.809568 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.810207 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.818560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.821048 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.822140 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.822920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.823378 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.823911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.913913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:14.925388 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-45210b26-10e5-4aeb-b0bf-96c68c0b1645 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1237 microversion: 2.1 time: 0.145169 Aug 29 21:36:14.926465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 107/219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:14 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:15.043094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:15.051359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6406ff44-85ce-4290-a944-d7c0eb2c9cc1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.255766 Aug 29 21:36:15.052020 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 113/220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:14 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:15.553807 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:15.554223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:15.557164 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:15.557816 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:15.558588 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:15.564787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.565214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.566530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.567588 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.568053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.568476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.594406 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0513f8c4-bc17-4a3c-b22e-00611a83a926 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/ips" status: 200 len: 146 microversion: 2.1 time: 0.044605 Aug 29 21:36:15.594973 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:36:15 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:15.842644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:15.843179 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:15.849222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.849703 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.850142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.850823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.851274 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.851699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.876397 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lazy-loading 'flavor' on Instance uuid f3f3dbb7-c3ca-46ab-9903-477493581b37 {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:36:15.947117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:15.947861 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:15.954353 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.954836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.955277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.955974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.956427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.957715 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.032651 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.042671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-27d11018-1367-4a9d-ab9b-449d8423a229 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1293 microversion: 2.1 time: 0.099602 Aug 29 21:36:16.056334 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 109/222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:15 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:16.067975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dcb11e77-b17c-4f98-951b-66a2eb4572c9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/action" status: 202 len: 0 microversion: 2.20 time: 0.229202 Aug 29 21:36:16.068565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 114/223] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 21:36:15 2022] POST /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:36:16.076888 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:16.077856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:16.078019 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:16.078917 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:16.084413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:16.084936 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:16.085363 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.086042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:16.086495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:16.086908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.089208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:16.090056 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:16.090814 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.092003 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:16.092931 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:16.093612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.113029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:16.295908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.306333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.307975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.308100 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.309186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-40cbf5cf-4700-4a6c-9add-6ed6fdb03444 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.236287 Aug 29 21:36:16.309755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 115/224] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:16 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:16.318807 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-839f6cd9-a1df-4c08-b3f5-593ae2a9e9c4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.247954 Aug 29 21:36:16.320249 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 110/225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:16 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:16.927463 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1698824656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-796113926", "security_groups": [{"name": "tempest-secgroup-smoke-365737483"}], "block_device_mapping_v2": [{"uuid": "a45b43a2-bd6f-4193-b745-942db89f81fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5e837a9d-67f3-4836-bdab-0e762646c779"}]}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:17.043000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] validate_networks() for [('5e837a9d-67f3-4836-bdab-0e762646c779', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:17.063206 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:17.063852 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:17.070910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.071428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.071873 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.072568 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.073063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.073512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.145672 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:17.153107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7d52b40b-8477-4244-8b4a-82e6777798ac tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1293 microversion: 2.1 time: 0.093756 Aug 29 21:36:17.153875 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 111/226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:17 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:17.333200 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:17.333858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:17.340273 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.340806 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.341244 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.341974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.342428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.342852 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.501487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:17.501903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:17.502370 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:17.502775 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:17.503182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:17.511813 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.512319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.512795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.513518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.513965 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.514382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.528785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:17.531936 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for project 98d4703c6737454291724a5ad15c9cbb. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:17.533390 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:17.537803 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for user d882c87d5de7497b822ec7b1798d2008 and project 98d4703c6737454291724a5ad15c9cbb. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:17.537964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:17.539396 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:17.540717 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-cd40fc20-b449-4532-9199-7a3b83725ca9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.211524 Aug 29 21:36:17.541524 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 112/227] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:17 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:17.546048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:17.546661 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:17.552688 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.553183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.553618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.554312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.554824 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.555247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.601628 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:17.603949 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a45b43a2-bd6f-4193-b745-942db89f81fc',volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:17.688836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:17.697222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e3dc0115-23ef-4ce3-896a-b5d91d9998db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.154819 Aug 29 21:36:17.697801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 113/228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:17 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:17.742627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f33356fe-468d-4bab-9745-9c916be39f56 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.818905 Aug 29 21:36:17.743277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 116/229] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:17.754514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c0845428-6439-41ca-a5ca-2483a8f732a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:17.755041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c0845428-6439-41ca-a5ca-2483a8f732a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:17.810983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c0845428-6439-41ca-a5ca-2483a8f732a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:17.821577 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c0845428-6439-41ca-a5ca-2483a8f732a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1094 microversion: 2.1 time: 0.071319 Aug 29 21:36:17.822168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 114/230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:17 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:18.174407 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:18.175018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:18.181750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.182237 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.182668 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.183358 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.183805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.184224 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.246222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.253812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6216f212-e37e-407b-92b2-456f9d714004 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1293 microversion: 2.1 time: 0.083923 Aug 29 21:36:18.254567 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 117/231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:18 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:18.566438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:18.567042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:18.574201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.574688 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.575127 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.575846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.576305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.576767 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.703248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.711378 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.712785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.714240 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-dda9f297-cfe9-4af1-95fe-925f9ac13020 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.152331 Aug 29 21:36:18.714951 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 115/232] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:18 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:18.718360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:18.718996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:18.725118 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.725597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.726033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.726710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.727398 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.727823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.842818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:18.843569 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:18.849565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.850133 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.850643 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.851409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:18.851935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:18.852446 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.866460 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.874479 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f9df3d5c-9aca-4945-b021-6db831bbcd17 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.159846 Aug 29 21:36:18.875600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 118/233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:18 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:18.917672 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.925215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ed75d522-9a97-4486-baa1-c8f3cc8cace6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1144 microversion: 2.1 time: 0.086296 Aug 29 21:36:18.925793 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 116/234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:18 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:19.276470 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:19.277129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:19.283638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.284115 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.285247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.285247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.285911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.286080 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.346920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:19.354360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-98eafae2-d9cb-4d34-9327-c0bef1e68c61 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1293 microversion: 2.1 time: 0.081827 Aug 29 21:36:19.354985 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 119/235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:19 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:19.736780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:19.737315 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:19.744289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.744817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.745257 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.745947 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.746408 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.746836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.878861 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:19.886867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:19.888341 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:19.889517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-cae15656-cf23-4622-a230-8a55b1f1d5b4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.156842 Aug 29 21:36:19.890063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 117/236] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:19 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:19.900050 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:19.900050 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:19.902994 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.903472 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.903903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.904609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.905051 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.905472 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.946413 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:19.947030 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:19.953574 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.954068 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.954508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.955206 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.955668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.956092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.027086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:20.034891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-45c7eaa7-e254-4834-a715-e368df8c1dfb tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1144 microversion: 2.1 time: 0.092174 Aug 29 21:36:20.035663 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 118/237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:19 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:20.064823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:20.072425 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f18068bc-7729-4408-8c25-fadc07c27ade tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.180212 Aug 29 21:36:20.073023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 120/238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:19 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:20.375991 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:20.376724 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:20.382908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.383399 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.383843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.384559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.385102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.385643 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.491855 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:20.500134 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b27a855c-d0ca-4a63-b9ff-c3757d87aa73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1301 microversion: 2.1 time: 0.128798 Aug 29 21:36:20.513346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 119/239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:20 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:20.913395 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:20.914690 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:20.920698 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.922103 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.922619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.923241 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.923927 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.924534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.056259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:21.056893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:21.063894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.064381 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.064958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.065535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.065990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.066416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.159762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:21.167645 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:21.169394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:21.171055 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:21.173008 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d9b81ee8-0993-4726-9496-aefcd8dcc1e6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.263498 Aug 29 21:36:21.173560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 121/240] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:20 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:21.178420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:21.179020 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:21.184645 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-85eb48f9-6ad2-4e79-9757-11485a8a3f9f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1192 microversion: 2.1 time: 0.132026 Aug 29 21:36:21.185430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.186343 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.187122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.188413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.189122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.189824 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.197417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 120/241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:21 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1192 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:21.366757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8c2a6a4-0779-4224-9f02-9e9623b4ac77"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:21.369908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:21.376119 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.376659 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.377738 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.378494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.378999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.379594 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.380781 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:21.389257 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f7122d48-b7bd-4410-8d22-ef78292c9128 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.214514 Aug 29 21:36:21.390100 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 122/242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:21 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:21.523080 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:21.523937 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:21.531747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.532427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.532895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.533758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:21.534223 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:21.534651 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:21.697771 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c7b15104-cbfe-452c-b0be-8517cff49498 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335283 Aug 29 21:36:21.700612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 121/243] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:36:21 2022] POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:21.950395 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:21.959121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-390ef94d-9fb7-471c-99f6-d98dc174d010 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.441431 Aug 29 21:36:21.960386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 123/244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:21 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:22.198296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:22.199232 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:22.208872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:22.209777 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:22.214064 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.214567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.215384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.216249 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.217771 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.218885 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.225731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.225731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.225731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.229970 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.230476 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.230912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.364084 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:22.371785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2bf5a3f9-0352-410a-85f3-9243d75a5ef4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1210 microversion: 2.1 time: 0.167651 Aug 29 21:36:22.372457 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 124/245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:22 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:22.412793 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:22.413550 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:22.422096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.422731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.423478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.424299 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.425008 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.425600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.673323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:22.681799 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:22.683319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:22.684520 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-31a2814e-c5ee-4afa-9c74-55295260ed54 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.492401 Aug 29 21:36:22.685157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 122/246] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:22 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:22.776414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:22.785608 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ae980751-abfe-49cf-bfe2-b09f6bac7d73 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.377868 Aug 29 21:36:22.786027 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 125/247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:22 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:22.982874 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:22.983505 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:22.990398 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.991073 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.991516 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.992220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.992710 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.993138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.298631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.307382 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-746971cb-6ff2-4729-b10f-62a14deb8854 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.328790 Aug 29 21:36:23.308000 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 123/248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:22 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:23.394613 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:23.395202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:23.403636 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.404360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.404964 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.405832 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.406536 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.407483 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.453701 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-dd579f1a-78e0-4041-8514-9748f80add37 req-295763a7-21f0-405b-bfaa-2b0387b5eedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af818bf6-764a-4013-a8f8-44c66e76a0e1", "tag": "3e7ea44e-fce2-4487-8d4e-03f6e49c779d"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:23.467115 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-dd579f1a-78e0-4041-8514-9748f80add37 req-295763a7-21f0-405b-bfaa-2b0387b5eedb service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.467800 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-dd579f1a-78e0-4041-8514-9748f80add37 req-295763a7-21f0-405b-bfaa-2b0387b5eedb service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.468228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-dd579f1a-78e0-4041-8514-9748f80add37 req-295763a7-21f0-405b-bfaa-2b0387b5eedb service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.482548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-dd579f1a-78e0-4041-8514-9748f80add37 req-295763a7-21f0-405b-bfaa-2b0387b5eedb service nova] Creating event network-changed:3e7ea44e-fce2-4487-8d4e-03f6e49c779d for instance af818bf6-764a-4013-a8f8-44c66e76a0e1 on hv-cinder-85426 Aug 29 21:36:23.488294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-dd579f1a-78e0-4041-8514-9748f80add37 req-295763a7-21f0-405b-bfaa-2b0387b5eedb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040073 Aug 29 21:36:23.493206 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 124/249] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:23.605053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.613060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-11b5b22a-3a99-4b29-a0e0-06b1708c419d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.223076 Aug 29 21:36:23.613636 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 126/250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:23 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:23.708636 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:23.709252 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:23.715369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.715853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.716285 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.716996 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.717481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.717902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.806558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:23.807160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:23.814041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.814532 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.814957 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.815658 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.816106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.816525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.884630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.898276 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.899741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.901237 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-91577838-e810-4d9e-a4b3-f85beb622dc7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.196899 Aug 29 21:36:23.901801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 125/251] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:23 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:23.959179 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.966762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-be2186eb-79de-4377-bdf5-2365201e9da3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.163974 Aug 29 21:36:23.967324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 127/252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:23 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:24.329173 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:24.329821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:24.336282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.336808 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.337246 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.337941 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.338397 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.338849 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.469751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:24.477868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-226087c3-9cc0-4be6-80a1-96da159cb027 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.152870 Aug 29 21:36:24.478433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 126/253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:24 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:24.635382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:24.636178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:24.642158 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.642637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.643310 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.644001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.644469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.644910 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.647417 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:24.782644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:24.790643 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4b71eb86-10b2-4424-9a9d-9f2c6df428b0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.159167 Aug 29 21:36:24.791209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 128/254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:24 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:24.923604 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:24.924216 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:24.930978 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.931507 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.931950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.932749 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.933210 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.933638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.988790 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:24.989474 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:24.996263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.996868 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.997362 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.998094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.998559 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.998991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.094062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:25.402956 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:25.411560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a8d518e4-bae4-4b89-ac79-2b6b4ab150d9 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.427623 Aug 29 21:36:25.424772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 129/255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:24 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:25.451988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:25.467949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:25.471876 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:25.474577 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-368a6f07-27da-46b4-9d2a-e0a28c0c6e37 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.554705 Aug 29 21:36:25.488679 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 127/256] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:24 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:25.501213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:25.501826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:25.508414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.508979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.509414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.510294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.510756 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.511205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.812987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:25.813594 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:25.820013 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.820507 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.820968 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.821663 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:25.822115 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:25.822532 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.143600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.151590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7c0ce39e-713f-46ef-882c-f886d428734e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.655580 Aug 29 21:36:26.152161 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:25 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:26.170094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.178426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-cb8b147b-5079-4bbe-97fa-9b66023f4bb4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.369890 Aug 29 21:36:26.178983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 128/258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:25 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:26.433253 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:26.434045 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:26.441521 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:26.442434 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:26.442872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.443580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:26.444380 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:26.445159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.501920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:26.502606 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:26.509095 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:26.509650 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:26.510203 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.510958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:26.511527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:26.512009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.830971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.840761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b72ac308-310a-4852-8f6a-0af6bb0426ad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.413133 Aug 29 21:36:26.841374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 131/259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:26 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:26.870610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-d532cd28-38c0-47fe-8ecd-ffc19a4f6d80 req-8acb6bfe-a0f0-4d1a-a390-2076f531cf4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8", "tag": "4035fd51-d29f-4d8c-bd5d-5ceb956be184"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:26.880658 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d532cd28-38c0-47fe-8ecd-ffc19a4f6d80 req-8acb6bfe-a0f0-4d1a-a390-2076f531cf4d service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:26.881166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d532cd28-38c0-47fe-8ecd-ffc19a4f6d80 req-8acb6bfe-a0f0-4d1a-a390-2076f531cf4d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:26.881591 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d532cd28-38c0-47fe-8ecd-ffc19a4f6d80 req-8acb6bfe-a0f0-4d1a-a390-2076f531cf4d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.888722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.902702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.904523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.906870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-851b0b02-9cb5-4409-baf8-d746bb5187ee tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.408111 Aug 29 21:36:26.907544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-d532cd28-38c0-47fe-8ecd-ffc19a4f6d80 req-8acb6bfe-a0f0-4d1a-a390-2076f531cf4d service nova] Creating event network-changed:4035fd51-d29f-4d8c-bd5d-5ceb956be184 for instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 on hv-cinder-85426 Aug 29 21:36:26.908252 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 129/260] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:26 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:26.926787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-d532cd28-38c0-47fe-8ecd-ffc19a4f6d80 req-8acb6bfe-a0f0-4d1a-a390-2076f531cf4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059023 Aug 29 21:36:26.926787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 132/261] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:27.173008 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:27.173618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:27.182169 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.183005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.183748 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.184956 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.185718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.186458 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.200933 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:27.201767 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:27.208575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.209092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.209561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.210442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.211087 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.211757 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.421195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:27.429259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f39c2cc1-17eb-4aac-8f8d-a5c1132c46f7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.260083 Aug 29 21:36:27.429826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 130/262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:27 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:27.430342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:27.434308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-48fb0ef5-ef7f-4cae-a8d8-7811c4d9e1eb req-7e64528e-4ec4-440b-80ee-68a283428676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446cfebe-c164-4c5b-8312-67dd13da2898", "name": "network-vif-plugged", "status": "completed", "tag": "d6330450-f0d1-4063-9b9d-1477fa88871b"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:27.438516 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d54aa81d-bb7c-4071-85d4-37700b014f7a tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.242509 Aug 29 21:36:27.439069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 133/263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:27 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:27.444231 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-48fb0ef5-ef7f-4cae-a8d8-7811c4d9e1eb req-7e64528e-4ec4-440b-80ee-68a283428676 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.444737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-48fb0ef5-ef7f-4cae-a8d8-7811c4d9e1eb req-7e64528e-4ec4-440b-80ee-68a283428676 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.445161 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-48fb0ef5-ef7f-4cae-a8d8-7811c4d9e1eb req-7e64528e-4ec4-440b-80ee-68a283428676 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.456389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-48fb0ef5-ef7f-4cae-a8d8-7811c4d9e1eb req-7e64528e-4ec4-440b-80ee-68a283428676 service nova] Creating event network-vif-plugged:d6330450-f0d1-4063-9b9d-1477fa88871b for instance 446cfebe-c164-4c5b-8312-67dd13da2898 on hv-cinder-85426 Aug 29 21:36:27.461373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-48fb0ef5-ef7f-4cae-a8d8-7811c4d9e1eb req-7e64528e-4ec4-440b-80ee-68a283428676 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030447 Aug 29 21:36:27.461945 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 131/264] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:27.863163 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:27.863929 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:27.866018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:27.866664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=24 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:27.873165 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.873748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.874212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.875487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.875968 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.876419 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.928575 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:27.933445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:27.934166 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:27.941300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.942004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.942437 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.943144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.943598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.944019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.095689 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.108382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-35500336-ba0d-4ae9-9f89-0d20210d3f5f tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.249749 Aug 29 21:36:28.109548 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 134/265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:27 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:28.138629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.148426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.150247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.151510 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3db3009f-1949-41eb-b18b-d30fabad6689 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.224382 Aug 29 21:36:28.152077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 132/266] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:27 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:28.450276 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:28.450843 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:28.457382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.457881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.458308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.458998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.459450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.459715 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:28.459872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.460317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:28.466214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.466691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.467120 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.467796 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.468887 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.469380 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.674314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.677986 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.682308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0e11d554-fa83-464e-833e-9d80cdff51b9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.235899 Aug 29 21:36:28.682883 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 135/267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:28 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:28.685488 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bfd1efd4-e667-4960-b1f0-14990388f358 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.229654 Aug 29 21:36:28.686041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 133/268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:28 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:29.130869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.131471 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.138424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.138911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.139344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.140042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.140491 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.140949 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.175423 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.176274 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.182979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.185838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.185838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.185838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.185838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.186706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.334124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.342009 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c3fecfe0-a53e-497d-b6ae-916929cde482 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.214887 Aug 29 21:36:29.342597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 136/269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:29.366452 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.375441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.376922 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.378095 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3d041b18-7a42-4d6e-b110-15ce1d7adc32 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.207216 Aug 29 21:36:29.378658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 134/270] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:29.703679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.704299 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.706195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:29.706816 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:29.710495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.710991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.711421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.712116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.712567 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.712743 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.713011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.713232 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.713671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.714362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:29.714831 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:29.715259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.945098 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.953206 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:29.962272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f97353f1-93fb-4c22-82c9-2191d8f6ae22 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.259825 Aug 29 21:36:29.962780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 135/271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:29.969738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-101f2d7c-a9f6-4800-be36-9098203f6e1f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.270079 Aug 29 21:36:29.970617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 137/272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:29 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:30.363119 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:30.363752 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:30.370181 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:30.370670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:30.371104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:30.371789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:30.372244 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:30.372702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:30.400610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:30.401238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:30.407107 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:30.407584 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:30.408014 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:30.408725 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:30.409182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:30.409842 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:30.569321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:30.577355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-dccef77f-22b2-4067-8a6d-34711f790c39 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.218160 Aug 29 21:36:30.577974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 136/273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:30 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:30.592251 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:30.605359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:30.607520 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:30.610473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-80d1bfbf-0c86-4c99-b253-619147684b8f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.213309 Aug 29 21:36:30.611370 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 138/274] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:30 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:30.984383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:30.985254 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:30.991726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:30.993182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:30.993950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:30.994457 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:30.994898 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:30.995618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:30.996082 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:30.996512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.000627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.001382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.001975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.003110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.003787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.004369 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.251667 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.264496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-71cbd237-180a-4591-bb81-0e47b342c448 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.280865 Aug 29 21:36:31.265951 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 137/275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:30 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:31.266670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.274998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-108dbd4f-ba0a-49b8-8d2c-79e990438f04 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.287500 Aug 29 21:36:31.275768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 139/276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:30 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:31.601449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:31.602003 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:31.609239 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.609728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.610164 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.610869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.611356 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.611783 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.637774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:31.638816 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:31.649057 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.649845 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.650532 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.651640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.652375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.653092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.834110 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.841974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.843045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a3835a2b-7277-4cbb-bc2a-7636c8fcea6e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.246842 Aug 29 21:36:31.843637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 138/277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:31 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:31.851012 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.852525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:31.853653 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b54086a9-1eb0-4b70-bbef-812b93de27c3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.222759 Aug 29 21:36:31.854214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 140/278] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:31 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:32.288841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:32.289680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:32.297235 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.298394 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.299053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.299987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.300565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.301025 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.304187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:32.305475 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:32.316821 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.317657 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.318580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.319589 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.320640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.321622 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.591138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:32.595638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:32.599910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-03af292d-61f2-4c07-82b3-15b17ddd3f0d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.317376 Aug 29 21:36:32.600490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 139/279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:32 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:32.604452 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4daf2f4d-c0b8-4da3-8e1a-b651f1a344de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.308935 Aug 29 21:36:32.605385 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8f161502-9eb9-433e-98fe-2bb77b7cf743 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:32.605964 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 141/280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:32 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:32.613897 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f161502-9eb9-433e-98fe-2bb77b7cf743 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.613897 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f161502-9eb9-433e-98fe-2bb77b7cf743 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.613897 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f161502-9eb9-433e-98fe-2bb77b7cf743 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.683635 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8f161502-9eb9-433e-98fe-2bb77b7cf743 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Going to try to stop instance {{(pid=127217) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:36:32.729903 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8f161502-9eb9-433e-98fe-2bb77b7cf743 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.128188 Aug 29 21:36:32.730530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 140/281] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:36:32 2022] POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:36:32.739334 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:32.739980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:32.746061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.746551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.746996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.747687 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.748146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.748574 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.869057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:32.869780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:32.876543 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.877059 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.877502 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.878211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.878669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.879153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.892522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:32.903564 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e7f45115-5c93-4873-ab19-beb7b8880428 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.167941 Aug 29 21:36:32.904386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 142/282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:32 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:32.909742 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:32.910458 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:32.916439 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.916978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.917511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:32.918579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:32.919076 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:32.919504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.112848 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:33.117117 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:33.121362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d367124b-37e6-4c7e-bd63-67fec612da46 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1370 microversion: 2.1 time: 0.256938 Aug 29 21:36:33.126884 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:33.127582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 141/283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:32 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:33.129445 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:33.131371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8af00da4-539d-4e2b-a336-a346422a60ec tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.225874 Aug 29 21:36:33.132306 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 143/284] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:32 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:33.314528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-d8be821f-7829-4dc7-b963-dd5f9d28c170 req-bc2c9122-b79c-4888-a459-2e6e16d761c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af818bf6-764a-4013-a8f8-44c66e76a0e1", "name": "network-vif-plugged", "status": "completed", "tag": "3e7ea44e-fce2-4487-8d4e-03f6e49c779d"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:33.334940 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d8be821f-7829-4dc7-b963-dd5f9d28c170 req-bc2c9122-b79c-4888-a459-2e6e16d761c7 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.335216 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d8be821f-7829-4dc7-b963-dd5f9d28c170 req-bc2c9122-b79c-4888-a459-2e6e16d761c7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.335650 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d8be821f-7829-4dc7-b963-dd5f9d28c170 req-bc2c9122-b79c-4888-a459-2e6e16d761c7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.349343 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-d8be821f-7829-4dc7-b963-dd5f9d28c170 req-bc2c9122-b79c-4888-a459-2e6e16d761c7 service nova] Creating event network-vif-plugged:3e7ea44e-fce2-4487-8d4e-03f6e49c779d for instance af818bf6-764a-4013-a8f8-44c66e76a0e1 on hv-cinder-85426 Aug 29 21:36:33.354891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-d8be821f-7829-4dc7-b963-dd5f9d28c170 req-bc2c9122-b79c-4888-a459-2e6e16d761c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043853 Aug 29 21:36:33.355792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 142/285] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:33.625641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:33.626351 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:33.628370 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:33.630299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:33.634289 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.634866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.635505 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.636624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.637142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.637274 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.637880 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.638310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.638633 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.639311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.639647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.643848 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.844220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:33.847825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:33.852836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7aa3c18f-254d-42ae-b156-2ecafac7e0a8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.230579 Aug 29 21:36:33.853436 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 143/286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:33 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:33.861751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c933bbdd-5ff6-4fc1-b280-84a46c4e5f30 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.239931 Aug 29 21:36:33.862991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 144/287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:33 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:33.926418 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:33.927039 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:33.933061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.933558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.933994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.935074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:33.935229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:33.935557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:33.951053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:34.144488 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:34.145591 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:34.152814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.153341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.153951 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.154769 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.154947 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:34.155261 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.155782 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.166099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c218906a-dce6-4756-9181-1933a0daea2c tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.243595 Aug 29 21:36:34.166862 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 144/288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:33 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:34.174620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:34.175500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:34.183296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.184083 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.184223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.185259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.185944 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.186541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.197708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=100 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:34.775558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:34.778066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:34.786309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ec997476-40f2-410e-a4b7-6fa72a700bce tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1564 microversion: 2.1 time: 0.646574 Aug 29 21:36:34.787593 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 145/289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:34 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1564 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:34.808427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:34.814629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:34.816233 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-daac8df6-d4b3-4e6a-bf96-9e2b02a1fe9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.648073 Aug 29 21:36:34.817017 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 145/290] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:34 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:34.818979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:34.819614 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:34.827800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.828308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.828803 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.830037 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.830268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.830934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.874854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:34.876012 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:34.882866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.883497 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.884267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.885138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.885694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.886196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.932522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-19e597c0-1401-4550-b1d0-e57e3015dc26 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118541 Aug 29 21:36:34.933624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 146/291] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:36:34 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:34.938421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:34.939029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:34.946624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.947112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.947770 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:34.948752 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:34.949240 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:34.949672 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.196649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:35.209906 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-542f1a49-d81f-4b84-a150-631c7d4f58cd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.339299 Aug 29 21:36:35.211668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 146/292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:34 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:35.217823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:35.219329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:35.228881 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.229780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.230304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.231030 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.231771 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.232441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.246675 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:35.262336 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c4e30510-ad0e-4f98-a8b0-bcb2d6213589 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.327272 Aug 29 21:36:35.263851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 147/293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:34 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:35.442871 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:35.452194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f12b8ada-79c3-441b-a7eb-d1a29161c4c3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.239208 Aug 29 21:36:35.452914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 147/294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:35 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:35.845216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:35.845823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:35.855445 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.859577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.860106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:35.860985 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:35.861596 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:35.862086 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.039269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.040702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-4cb6f08d-ef27-49fb-8ba9-414ffdb0a1c4 req-f5c191cf-c9e8-432e-9f07-2759e71a57a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446cfebe-c164-4c5b-8312-67dd13da2898", "tag": "d6330450-f0d1-4063-9b9d-1477fa88871b"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:36.050352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.052071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4cb6f08d-ef27-49fb-8ba9-414ffdb0a1c4 req-f5c191cf-c9e8-432e-9f07-2759e71a57a6 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.052352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.052559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4cb6f08d-ef27-49fb-8ba9-414ffdb0a1c4 req-f5c191cf-c9e8-432e-9f07-2759e71a57a6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.053190 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4cb6f08d-ef27-49fb-8ba9-414ffdb0a1c4 req-f5c191cf-c9e8-432e-9f07-2759e71a57a6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.053986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e6b91b55-74c5-4076-974d-399bbb1a6b3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.216725 Aug 29 21:36:36.069746 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 148/295] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:35 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:36.084255 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-4cb6f08d-ef27-49fb-8ba9-414ffdb0a1c4 req-f5c191cf-c9e8-432e-9f07-2759e71a57a6 service nova] Creating event network-changed:d6330450-f0d1-4063-9b9d-1477fa88871b for instance 446cfebe-c164-4c5b-8312-67dd13da2898 on hv-cinder-85426 Aug 29 21:36:36.093062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-4cb6f08d-ef27-49fb-8ba9-414ffdb0a1c4 req-f5c191cf-c9e8-432e-9f07-2759e71a57a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057232 Aug 29 21:36:36.093664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 148/296] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:36.235577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:36.236349 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:36.245675 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.246335 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.246862 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.247775 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.248436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.248774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.290573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:36.291726 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:36.302858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.303611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.304375 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.306718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.307202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.307631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.480342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.491852 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8c655a0c-abfb-419b-a6d6-579f3ba13d2f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1366 microversion: 2.1 time: 0.260196 Aug 29 21:36:36.493294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 149/297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:36 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:36.499427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:36.500301 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:36.511426 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.511971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.512428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.513603 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:36.514077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:36.514514 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:36.544945 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.560670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ff12fdf2-2212-45d7-82aa-e245333fc30b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.275259 Aug 29 21:36:36.562669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 149/298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:36 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:36.679340 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:36.688106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-319227d2-a9dd-41d2-ac33-52583cddae6e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.193523 Aug 29 21:36:36.689010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 150/299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:36 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:37.079254 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:37.080537 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:37.088636 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.092138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.092138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.094137 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.094816 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.095414 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.334128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:37.350497 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:37.352576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:37.354479 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a5ede032-7b47-4149-8e86-7f87e3626f26 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.279564 Aug 29 21:36:37.355642 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 150/300] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:37 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:37.514048 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:37.514921 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:37.522831 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.523574 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.524364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.525264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.525880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.528895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.583206 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:37.584201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:37.598643 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.599519 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.600357 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.601308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.602142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.602791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.766402 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:37.778157 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-51dc4941-534f-428b-a9c9-424d1ff917e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1556 microversion: 2.1 time: 0.268276 Aug 29 21:36:37.778807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 151/301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:37 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1556 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:37.786953 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:37.787594 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:37.797391 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.797775 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.798210 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.798923 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.799377 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.799805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.822708 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:37.832903 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6d761a28-8ba7-4c82-9325-80d6aec8bd29 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.254018 Aug 29 21:36:37.834601 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 151/302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:37 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:37.839688 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:37.840429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:37.849397 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.850016 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.850690 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.851666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:37.852207 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:37.852759 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:37.967265 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-521ab0f7-0afe-4305-856c-956d54b68f93 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131601 Aug 29 21:36:37.967856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 152/303] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:36:37 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:38.014111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:38.024483 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-69f185ce-0065-4b78-b778-0504956f2f79 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.243899 Aug 29 21:36:38.025310 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 152/304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:37 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:38.380460 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:38.381232 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:38.387070 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:38.387802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:38.388236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:38.388951 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:38.393381 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:38.394183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:38.853859 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:38.855004 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:38.861851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:38.862950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:38.863729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:38.865750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:38.866595 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:38.867269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:38.966925 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:38.978093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:38.980407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:38.982330 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-947074d4-e04b-4b0a-817a-e06f62f709f4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.606223 Aug 29 21:36:38.983136 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 153/305] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:38 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:39.050240 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:39.052764 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:39.062286 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.062910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.063425 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.064291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.064889 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.066428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.191039 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:39.202254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b4c6d03d-b740-4a93-8fde-d8b1a47c15ab tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.351842 Aug 29 21:36:39.203544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 153/306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:38 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:39.336938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:39.345658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-eae21d4f-0818-4a6c-84d6-d3900d6e7471 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.301420 Aug 29 21:36:39.346515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 154/307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:39 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:39.649575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-1a2650b0-f327-46ad-8f15-3a7ae2efe001 req-7d29eb8b-2fcd-46e9-887a-d012e4014750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af818bf6-764a-4013-a8f8-44c66e76a0e1", "tag": "3e7ea44e-fce2-4487-8d4e-03f6e49c779d"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:39.659378 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-1a2650b0-f327-46ad-8f15-3a7ae2efe001 req-7d29eb8b-2fcd-46e9-887a-d012e4014750 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.659857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-1a2650b0-f327-46ad-8f15-3a7ae2efe001 req-7d29eb8b-2fcd-46e9-887a-d012e4014750 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.660289 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-1a2650b0-f327-46ad-8f15-3a7ae2efe001 req-7d29eb8b-2fcd-46e9-887a-d012e4014750 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.674346 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-1a2650b0-f327-46ad-8f15-3a7ae2efe001 req-7d29eb8b-2fcd-46e9-887a-d012e4014750 service nova] Creating event network-changed:3e7ea44e-fce2-4487-8d4e-03f6e49c779d for instance af818bf6-764a-4013-a8f8-44c66e76a0e1 on hv-cinder-85426 Aug 29 21:36:39.679561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-1a2650b0-f327-46ad-8f15-3a7ae2efe001 req-7d29eb8b-2fcd-46e9-887a-d012e4014750 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034444 Aug 29 21:36:39.680156 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 154/308] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:40.006349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:40.006990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:40.013584 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.014079 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.014523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.015222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.015683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.016110 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.226877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:40.227893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:40.234185 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:40.235940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.237182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.237943 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.238935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.239637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.240111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.248329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:40.251198 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:40.253340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c9b89019-52da-47c8-9d86-d1389ee4bf53 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.250986 Aug 29 21:36:40.255334 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 155/309] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:40 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:40.367629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:40.368251 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:40.374472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.375082 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.375524 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.376220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:40.376902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:40.377620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.521884 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:40.534167 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f18e63eb-05cf-42b9-979c-db611b282d65 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.312752 Aug 29 21:36:40.534762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 155/310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:40 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:40.614454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:40.623427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6ca96840-c80c-4fa2-a398-e067472ad3bc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.259995 Aug 29 21:36:40.624322 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 156/311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:40 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:41.278774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:41.280004 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:41.286904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.287383 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.287846 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.288497 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.288979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.289444 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.433302 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:41.441815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:41.443276 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:41.444440 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-725fbd2a-0d11-4609-ae81-b33f2d7b2228 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.169615 Aug 29 21:36:41.445026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 156/312] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:41 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:41.555408 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:41.555922 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:41.558373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=100 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:41.564391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.564901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.565335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.566035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.566491 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.566915 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.644264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:41.644994 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:41.652467 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.652986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.653422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.654120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:41.654580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:41.655007 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:41.717694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:41.726723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6f751a9d-16a3-4e85-b27d-34c2eae95c04 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.175149 Aug 29 21:36:41.727321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 157/313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:41 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:41.926312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:41.934469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-57b64f42-ee55-4056-8581-bc22d7160520 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.295014 Aug 29 21:36:41.935039 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 157/314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:41 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:42.467208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:42.468339 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:42.474410 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.474897 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.475327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.476010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.476464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.477057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.616271 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:42.625213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:42.626759 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:42.628196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ad66dc0f-a6b3-44fd-9ab5-51dc328ee885 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1743 microversion: 2.20 time: 0.164819 Aug 29 21:36:42.628863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 158/315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:42 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:42.747645 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:42.748426 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:42.755974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.756477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.757046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.757747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.758204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.758628 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.904709 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:42.913394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-37aa497e-04a6-462b-8eec-c7fdd6eb192b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.169748 Aug 29 21:36:42.913961 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 158/316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:42 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:42.956317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:42.956943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:42.965959 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.966629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.968926 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:42.969738 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:42.970459 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:42.970961 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.165902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:43.177629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3e4a5d8a-729e-4ba7-a548-de8f5d4e120b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.224657 Aug 29 21:36:43.178538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 159/317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:42 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:43.614169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-dfaf6edb-a1fc-479f-97bf-cae08f740aac req-d26754b8-3c62-40ce-98a2-2490328170c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8", "name": "network-vif-plugged", "status": "completed", "tag": "4035fd51-d29f-4d8c-bd5d-5ceb956be184"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:43.627109 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-dfaf6edb-a1fc-479f-97bf-cae08f740aac req-d26754b8-3c62-40ce-98a2-2490328170c7 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.628422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-dfaf6edb-a1fc-479f-97bf-cae08f740aac req-d26754b8-3c62-40ce-98a2-2490328170c7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.628922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-dfaf6edb-a1fc-479f-97bf-cae08f740aac req-d26754b8-3c62-40ce-98a2-2490328170c7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.643037 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-dfaf6edb-a1fc-479f-97bf-cae08f740aac req-d26754b8-3c62-40ce-98a2-2490328170c7 service nova] Creating event network-vif-plugged:4035fd51-d29f-4d8c-bd5d-5ceb956be184 for instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 on hv-cinder-85426 Aug 29 21:36:43.648987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-dfaf6edb-a1fc-479f-97bf-cae08f740aac req-d26754b8-3c62-40ce-98a2-2490328170c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038740 Aug 29 21:36:43.649590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 159/318] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:43.651675 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:43.652392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:43.660995 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.661797 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.662323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.663287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.663933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.664447 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.820975 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:43.830072 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:43.831707 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:43.832992 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3a0d64bf-15ae-4ac5-ad0b-f5c625ed948f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1743 microversion: 2.20 time: 0.185149 Aug 29 21:36:43.833576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 160/319] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:43 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:43.937023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:43.938518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:43.946240 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.946734 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.947174 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.947870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.948481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.949163 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:44.199686 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:44.201123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:44.214664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:44.215383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:44.215960 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:44.218436 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:44.219075 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:44.222882 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:44.262265 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:44.273785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0af4f448-a0b1-4820-ad03-7c7f5014bad3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.342077 Aug 29 21:36:44.274454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 160/320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:43 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:44.381025 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:44.390375 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8959eeb6-6eb3-4ca4-94ab-f557dd5eb884 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.194369 Aug 29 21:36:44.391028 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 161/321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:44 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:44.862073 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:44.866915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:44.877887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:44.878872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:44.879655 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:44.880932 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:44.882097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:44.882909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.058247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:45.069303 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:45.071272 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:45.072668 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-618894ae-f7f8-49e6-adeb-7d2ccc9bdb12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.219392 Aug 29 21:36:45.074061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 161/322] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:44 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:45.296712 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:45.296712 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:45.303257 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.303812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.304288 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.305300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.305759 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.306358 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.310816 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=100 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:45.413639 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:45.415664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:45.418881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:45.433821 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.434832 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.435096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.435886 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.437032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.437534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.495404 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:45.509406 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b950bf4b-65a3-42d7-851e-da00e0879b26 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1265 microversion: 2.1 time: 0.216480 Aug 29 21:36:45.520610 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 162/323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:45 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:45.613028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:45.625619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-50547d72-1687-486f-8ede-940ee0d09204 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.216654 Aug 29 21:36:45.626442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 162/324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:45 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:45.665514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-f676dc78-0a07-4b31-8502-d706923507c9 req-63ae2185-1607-4b99-9697-07fc3f972933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f3dbb7-c3ca-46ab-9903-477493581b37", "name": "network-vif-plugged", "status": "completed", "tag": "9a89d54f-b4bb-438b-aba7-0e6acacc72c3"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:45.675964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-f676dc78-0a07-4b31-8502-d706923507c9 req-63ae2185-1607-4b99-9697-07fc3f972933 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:45.676445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-f676dc78-0a07-4b31-8502-d706923507c9 req-63ae2185-1607-4b99-9697-07fc3f972933 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:45.676914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-f676dc78-0a07-4b31-8502-d706923507c9 req-63ae2185-1607-4b99-9697-07fc3f972933 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:45.691201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-f676dc78-0a07-4b31-8502-d706923507c9 req-63ae2185-1607-4b99-9697-07fc3f972933 service nova] Creating event network-vif-plugged:9a89d54f-b4bb-438b-aba7-0e6acacc72c3 for instance f3f3dbb7-c3ca-46ab-9903-477493581b37 on hv-cinder-85426 Aug 29 21:36:45.697178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-f676dc78-0a07-4b31-8502-d706923507c9 req-63ae2185-1607-4b99-9697-07fc3f972933 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035224 Aug 29 21:36:45.698328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 163/325] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:46.099040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:46.099878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:46.125881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.126472 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.126829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.127562 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.129386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.129813 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.332323 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:46.334999 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=100 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:46.344101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:46.346484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:46.347934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-517e3f70-a693-4fe5-a74c-6e2a338a40e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.253093 Aug 29 21:36:46.348727 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 163/326] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:46 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:46.560327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:46.561869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:46.570612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.571499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.572326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.573771 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.574586 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.575276 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.648087 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:46.648740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:46.669905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.670330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.670806 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.671519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.671976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.672402 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.979379 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:46.989654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-853d0917-37de-478f-826b-819b8096ee59 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1451 microversion: 2.1 time: 0.460755 Aug 29 21:36:46.990537 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 164/327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:46 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1451 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:47.012626 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:47.013548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:47.020310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:47.020705 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:47.021350 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:47.022069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:47.022528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:47.022952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:47.044962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:47.059778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f749cf6b-8031-45e6-8a3f-d8c56948e623 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.415488 Aug 29 21:36:47.061486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 164/328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:46 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:47.199757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:47.212827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-73930c42-2526-4668-bb33-7f600deaf26b tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1451 microversion: 2.1 time: 0.203636 Aug 29 21:36:47.215108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 165/329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:47 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1451 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:47.377522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:47.379161 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:47.388048 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:47.388543 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:47.389209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:47.390654 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:47.391331 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:47.391919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:47.586552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:47.598940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:47.600880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:47.602374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3b22ebc9-0106-49ad-91f2-d45ee9923926 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.230562 Aug 29 21:36:47.603443 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 165/330] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:47 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:48.089626 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:48.092568 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:48.104818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:48.105673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:48.106128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:48.106844 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:48.107391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:48.107998 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:48.379932 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:48.392987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e961411d-ab10-455c-a145-20362de66e74 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.308561 Aug 29 21:36:48.394302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 166/331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:48 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:48.626036 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:48.626755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:48.637598 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:48.638376 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:48.638987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:48.640448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:48.641095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:48.641683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:49.268896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:49.288172 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:49.289931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:49.291105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e9f85b3a-6bd3-4065-a01c-0c62887ddc51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.669144 Aug 29 21:36:49.292020 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 166/332] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:48 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:49.419352 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:49.420374 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:49.432114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:49.432798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:49.434044 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:49.435446 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:49.436324 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:49.441150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:49.813035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:49.826469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8f5b8506-844d-479b-870a-14d53bf3dd5e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.414219 Aug 29 21:36:49.831442 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 167/333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:49 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:50.319967 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:50.320812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:50.332017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.335616 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.338304 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.341904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.343456 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.344716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.674780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:50.683913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:50.685786 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:50.690704 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0e52d24f-f453-4fab-b8d6-993dd52ddc64 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.378195 Aug 29 21:36:50.691421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 167/334] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:50 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:50.857726 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:50.860535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:50.892128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.893103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.894137 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.895639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.896754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.897787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:51.149740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-d7008458-fc54-4bba-a824-1980dbe4a78d req-49029292-d95a-42e9-97b1-571f0d293ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8", "tag": "4035fd51-d29f-4d8c-bd5d-5ceb956be184"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:51.210261 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d7008458-fc54-4bba-a824-1980dbe4a78d req-49029292-d95a-42e9-97b1-571f0d293ba1 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:51.211297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d7008458-fc54-4bba-a824-1980dbe4a78d req-49029292-d95a-42e9-97b1-571f0d293ba1 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:51.211747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d7008458-fc54-4bba-a824-1980dbe4a78d req-49029292-d95a-42e9-97b1-571f0d293ba1 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:51.246969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-d7008458-fc54-4bba-a824-1980dbe4a78d req-49029292-d95a-42e9-97b1-571f0d293ba1 service nova] Creating event network-changed:4035fd51-d29f-4d8c-bd5d-5ceb956be184 for instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 on hv-cinder-85426 Aug 29 21:36:51.248043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:51.262663 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-d7008458-fc54-4bba-a824-1980dbe4a78d req-49029292-d95a-42e9-97b1-571f0d293ba1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120313 Aug 29 21:36:51.266024 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 168/335] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:51.283135 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3824ac2e-0d17-4f1e-a70d-25abb9654944 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.433961 Aug 29 21:36:51.284338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 168/336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:50 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:51.723853 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:51.724706 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:51.732843 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:51.736119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:51.737538 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:51.747931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:51.749180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:51.750166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:52.130054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.141712 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.146812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.148812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6791dd90-5561-4905-8992-2b2543e03ded tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.430322 Aug 29 21:36:52.153944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 169/337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:51 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:52.320702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:52.323386 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:52.345109 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:52.346582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:52.347863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:52.351827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:52.355373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:52.357277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:52.600383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.621297 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0ed888b7-711a-45c9-9a84-811a2e850950 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1725 microversion: 2.1 time: 0.316483 Aug 29 21:36:52.624632 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 169/338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:52 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:53.184434 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:53.189040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:53.205373 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.206202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.206838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.207719 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.208312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.208939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.453345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.464982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.466805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.468766 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a29671a7-8972-4275-b350-afb936f5b2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.288926 Aug 29 21:36:53.469798 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 170/339] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:53 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:53.645902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:53.646511 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:53.652907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.653584 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.654537 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.655368 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.656259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.656858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.812407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.822202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-52e649b8-163a-4f2a-a639-c1ed9b844fdc tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1702 microversion: 2.1 time: 0.180398 Aug 29 21:36:53.823145 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 170/340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:53 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1702 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:53.844152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-51467c73-08ff-44b7-93bf-43ed6fc5bb38 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:53.852230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51467c73-08ff-44b7-93bf-43ed6fc5bb38 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.852764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51467c73-08ff-44b7-93bf-43ed6fc5bb38 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.853398 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-51467c73-08ff-44b7-93bf-43ed6fc5bb38 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.940420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-51467c73-08ff-44b7-93bf-43ed6fc5bb38 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Going to try to start instance {{(pid=127216) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:36:53.993131 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-51467c73-08ff-44b7-93bf-43ed6fc5bb38 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.152783 Aug 29 21:36:53.995150 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 171/341] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:36:53 2022] POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:36:54.005528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:54.006132 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:54.014655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.017295 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.018151 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.019018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.019538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.019972 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.306193 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.316093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-86616d62-1fb4-4a08-a70e-152e456897c9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1711 microversion: 2.1 time: 0.314208 Aug 29 21:36:54.316944 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 171/342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:54 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1711 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:54.500458 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:54.501445 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:54.513054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.515796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.516431 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.518657 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.519291 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.520774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.871628 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.882969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.884985 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.886340 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-66bc0c9b-f260-420d-a919-c86e629fac99 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.392123 Aug 29 21:36:54.887065 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 172/343] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:54 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:55.342726 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:55.344063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:55.353973 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.354724 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.355344 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.357312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.357312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.357312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.518826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:55.531434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7ecea2cd-99f0-4944-bac3-fa21878f7653 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1711 microversion: 2.1 time: 0.192553 Aug 29 21:36:55.533644 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 172/344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:55 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1711 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:55.910561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:55.912122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:55.921778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.922570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.923181 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.924371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.925525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.926173 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.081012 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.089874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.091444 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.093230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-20a7a0a6-2f68-463b-accd-5248a336411c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.187282 Aug 29 21:36:56.094027 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 173/345] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:55 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:56.557843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:56.559049 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:56.569040 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.569519 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.569949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.570648 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.571099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.571701 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.730947 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.744956 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bc45ee9a-ff21-40f1-90ff-5c5c2ce7f101 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1711 microversion: 2.1 time: 0.193699 Aug 29 21:36:56.747227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 173/346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:56 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1711 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:57.117548 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:57.118338 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:57.128694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.129566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.131499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.132471 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.133058 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.133729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.299845 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:57.309871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:57.311438 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:57.312638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-52544e0a-7bcb-4e1e-b5d7-40d12bc19d83 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.200053 Aug 29 21:36:57.313188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 174/347] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:57 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:57.785805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:57.786450 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:57.793076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.793560 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.793998 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.794689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.795148 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.795573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.932320 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:57.940508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-95e2d23e-3265-45fb-b160-8a7a53e13917 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1711 microversion: 2.1 time: 0.158751 Aug 29 21:36:57.941085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:57 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:58.335712 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:58.336373 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:58.343139 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.343617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.344071 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.344790 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.345240 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.345797 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.478343 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:58.487077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:58.488511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:58.489667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a2f12c16-1d71-4e9f-8cc4-63162dedb892 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1738 microversion: 2.20 time: 0.157917 Aug 29 21:36:58.490216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 175/349] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:58 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:58.961663 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:58.962242 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:58.969215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.969694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.970124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.970820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.971299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.971715 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.118708 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.128492 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ff9957b4-c34a-4f36-8688-ad971557b279 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1715 microversion: 2.1 time: 0.170503 Aug 29 21:36:59.129107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 175/350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:58 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:59.512726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:59.513326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:59.519640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:59.520119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:59.520545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.521254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:59.521696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:59.522115 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.649247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.657773 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.659270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.660440 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d89cd0a9-4896-4753-84ac-3c989bf967ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1720 microversion: 2.20 time: 0.151620 Aug 29 21:36:59.661041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 176/351] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:59 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:00.683843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:00.684440 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:00.691446 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.691924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.692349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.693054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.693503 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.693922 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.823972 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.832634 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.834094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.835239 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b6ff4848-cdea-4810-8d16-a7034e18e93a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1720 microversion: 2.20 time: 0.155307 Aug 29 21:37:00.835798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 176/352] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:00 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:01.859324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:01.860081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:01.866577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.867064 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.867493 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.868184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.868724 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.869143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.007041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.015963 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.017707 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.019199 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8f179bb6-ff1c-4953-8245-a959abbf4493 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1720 microversion: 2.20 time: 0.163820 Aug 29 21:37:02.019763 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 177/353] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:01 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:02.504106 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-1153d1c8-7e45-4899-9a47-4a1c30c9111a req-1b439d2a-491a-4e6e-b151-b4d735e79890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f3dbb7-c3ca-46ab-9903-477493581b37", "name": "network-vif-unplugged", "status": "completed", "tag": "9a89d54f-b4bb-438b-aba7-0e6acacc72c3"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:02.515672 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-1153d1c8-7e45-4899-9a47-4a1c30c9111a req-1b439d2a-491a-4e6e-b151-b4d735e79890 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.516500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-1153d1c8-7e45-4899-9a47-4a1c30c9111a req-1b439d2a-491a-4e6e-b151-b4d735e79890 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.517026 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-1153d1c8-7e45-4899-9a47-4a1c30c9111a req-1b439d2a-491a-4e6e-b151-b4d735e79890 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.529092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-1153d1c8-7e45-4899-9a47-4a1c30c9111a req-1b439d2a-491a-4e6e-b151-b4d735e79890 service nova] Creating event network-vif-unplugged:9a89d54f-b4bb-438b-aba7-0e6acacc72c3 for instance f3f3dbb7-c3ca-46ab-9903-477493581b37 on hv-cinder-85426 Aug 29 21:37:02.536058 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-1153d1c8-7e45-4899-9a47-4a1c30c9111a req-1b439d2a-491a-4e6e-b151-b4d735e79890 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037366 Aug 29 21:37:02.537271 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 177/354] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:03.041526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:03.042062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:03.048416 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.049266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.049499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.050043 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.050493 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.050911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.182278 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:03.190891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:03.192322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:03.193526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1e69e518-05f9-4e5e-9fa3-af00afe3df79 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1720 microversion: 2.20 time: 0.155967 Aug 29 21:37:03.194075 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 178/355] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:03 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:04.218013 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:04.218744 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:04.225435 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.225945 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.226405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:04.227145 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.227627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.228054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:04.367652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.376773 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.378237 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.379381 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3aa2620e-6085-475d-86cd-403bd77a8a12 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1720 microversion: 2.20 time: 0.166548 Aug 29 21:37:04.379950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 178/356] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:04 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:05.403422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:05.404019 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:05.411074 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.411568 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.412041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.412842 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.413353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.413795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.553327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:05.561881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:05.563304 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:05.564446 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-79bc04b5-e036-496b-a6c6-3bfab5887962 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1723 microversion: 2.20 time: 0.165416 Aug 29 21:37:05.565040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 179/357] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:05 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:05.588091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11fd2f45-987a-48f9-92c8-f9b934089f40"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:05.590422 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:05.597208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.597722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.598158 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.598854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.599310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.599732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.689448 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=100 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:05.910801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f7755ae6-410f-4055-a6ef-e090e39ddc35 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326674 Aug 29 21:37:05.911437 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 179/358] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 29 21:37:05 2022] POST /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:37:06.038597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:06.039202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:06.046118 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.046615 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.047077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.047761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.048320 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.048884 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.052968 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:06.102059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127216) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:37:06.190160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dbe1c1a1-e814-48d5-ab55-191a790d2bd2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/action" status: 202 len: 0 microversion: 2.20 time: 0.156107 Aug 29 21:37:06.190736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 180/359] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 21:37:06 2022] POST /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:37:06.198999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:06.199614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:06.206766 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.207138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.207576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.208287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.208776 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.209197 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.366316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.377961 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.379603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.381675 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4665ae6d-69d6-411b-806a-b8a1aaf48a44 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1749 microversion: 2.20 time: 0.186318 Aug 29 21:37:06.382755 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 180/360] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:06 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1749 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:07.406886 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:07.407562 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:07.414193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.414729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.415204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.415952 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.416447 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.416939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.566212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.575459 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.576944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.578408 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-db5f1b1e-771f-4759-8ce7-685ebd12f48b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1749 microversion: 2.20 time: 0.176262 Aug 29 21:37:07.578978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 181/361] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:07 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:08.613208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:08.613925 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:08.621099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.621598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.622089 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.622858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.623807 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.624410 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.785279 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.794523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.796315 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.797512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c2a1743b-f87c-4a3f-8662-807d40f546ba tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1749 microversion: 2.20 time: 0.188618 Aug 29 21:37:08.798077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 181/362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:08 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1749 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:09.822230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:09.822840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:09.828977 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.829465 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.829896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.830589 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.831039 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.831457 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.968481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:09.977580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:09.979047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:09.980246 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ccc13e00-2929-4cba-a126-3408422c17e9 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1751 microversion: 2.20 time: 0.162152 Aug 29 21:37:09.980911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 182/363] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:09 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:11.003261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:11.003816 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:11.010683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.011162 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.011598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.012277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.012755 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.013174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.151436 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.160706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.162154 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.163300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-adcf491a-cc1a-4f78-9c28-25028965de3c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.163992 Aug 29 21:37:11.163856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 182/364] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:10 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:12.188227 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:12.190025 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:12.198700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.201546 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.202301 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.203745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.204733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.205885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.443164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.453382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.454920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.456104 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f5c54252-40d2-4e67-be26-43550edacad1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.273111 Aug 29 21:37:12.457874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 183/365] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:12 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:13.479994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:13.481018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:13.484034 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=52 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:13.489756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.490275 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.490708 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:13.491753 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.492215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.492689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:13.640247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:13.649845 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:13.651259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:13.652449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9696e1ce-a469-4b1b-bc3c-a6d224a3d7f5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.176592 Aug 29 21:37:13.661032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 183/366] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:13 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:14.680849 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:14.682123 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:14.693141 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:14.694112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:14.695112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.696358 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:14.697400 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:14.698371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.992467 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.006198 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.011151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.019413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-180b0fa0-efe3-4f12-a972-827aa4f1d5ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.346419 Aug 29 21:37:15.020436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 184/367] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:14 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:16.061096 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:16.063138 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:16.075005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.075981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.076877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.077679 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.078428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.079246 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.306303 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.338865 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.340397 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.345053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0a20d55c-4f2d-43c9-ba1e-d2ace0e43617 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.285376 Aug 29 21:37:16.346748 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 184/368] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:16 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:17.379578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:17.380373 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:17.387922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:17.390404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.390982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.391656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:17.392925 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.393678 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.394498 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:17.562998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:17.571988 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:17.573508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:17.574707 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6b00f37e-ad84-4981-b68e-de9a45979115 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.200876 Aug 29 21:37:17.575265 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 185/369] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:17 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:18.612033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:18.613590 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:18.621802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:18.622302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:18.623316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:18.624276 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:18.624769 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:18.625418 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:18.810905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:18.822983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:18.825920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:18.827639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-61a28207-0b4d-470c-9bb2-0392e9050d93 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.219558 Aug 29 21:37:18.828554 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 185/370] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:18 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:19.873920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:19.875017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:19.885400 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:19.886247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:19.887441 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:19.889683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:19.890759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:19.891709 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:20.117048 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.126609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.128158 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.129786 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-63538086-3dbb-4939-81b1-8a2ca58d471e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.262612 Aug 29 21:37:20.130650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 186/371] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:19 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:21.167470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:21.168494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:21.177384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.178455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.179240 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.180325 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.191723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.192812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.439619 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.455727 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.460471 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.462912 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3d984e42-872d-4875-9e8f-b2895efb074d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.299157 Aug 29 21:37:21.463819 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 186/372] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:21 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:22.500855 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:22.501940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:22.512433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.513686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.513978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.514731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.515300 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.515846 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.779500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.791366 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.793027 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.794949 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b5a0f5d1-da7e-4c36-a8e5-301a31c4e782 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.301282 Aug 29 21:37:22.795528 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 187/373] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:22 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:23.819552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:23.820251 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:23.831493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:23.832233 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:23.832948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:23.834048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:23.834859 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:23.835988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:23.986166 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:23.995531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:23.997003 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:23.998787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c33fbae1-4f76-4334-9452-6af92305513d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.183886 Aug 29 21:37:23.999354 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 187/374] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:23 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:25.038029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:25.038624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:25.044944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.045694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.046164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.046869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.047404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.047811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.215611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:25.224769 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:25.226231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:25.227405 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a57b6f4e-3124-41c2-a450-119ab165eb2d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.193468 Aug 29 21:37:25.227966 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 188/375] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:25 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:26.251081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:26.251710 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:26.258722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.259223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.259659 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.260373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.260873 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.261365 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.419916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:26.442212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:26.442212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:26.442212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-cb4ae134-6f3e-4a08-b150-033e69daec87 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.194387 Aug 29 21:37:26.442522 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 188/376] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:26 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:27.471109 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:27.472054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:27.482966 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.483579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.484028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.485143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.485320 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.485649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.663303 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:27.678772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:27.680428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:27.682420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0eacde2e-ced2-4272-adf7-6c589e8dd035 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.216697 Aug 29 21:37:27.683344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 189/377] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:27 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:28.710273 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:28.711360 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:28.726101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.726892 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.727747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.729022 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.729818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.730520 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.967227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.984859 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.988524 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.990839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3dd85dae-ef06-4c1f-b4f1-a50a3b1adb72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.286185 Aug 29 21:37:28.991847 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 189/378] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:28 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:30.019245 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:30.019872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:30.026563 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.027051 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.027482 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.028184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.029295 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.029715 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.187262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:30.196527 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:30.197995 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:30.199209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-06f02ec5-c18b-4416-bd9c-99c4974adae1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.184313 Aug 29 21:37:30.199764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 190/379] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:30 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:31.222982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:31.223560 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:31.231654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.232241 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.232787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.233556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.234066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.234533 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.411273 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.425737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.427722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.430756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d15b8cf0-c723-4ace-9623-c35358522adc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.211033 Aug 29 21:37:31.432369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 190/380] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:31 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:32.300368 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b76469e-5342-40cb-b999-f13d2bbf6579"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:32.304268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.314656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.315497 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.316107 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.317083 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.317811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.318532 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.469400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:32.470378 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.481958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.482678 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.484515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.486389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.487132 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.487855 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.675130 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.684303 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-15852b71-67e0-4fb5-8204-b4e54323b2f3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391364 Aug 29 21:37:32.685238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 191/381] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:37:32 2022] POST /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:32.687162 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.688971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.690354 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b88f8c9b-0f71-4686-a9a4-161bf47797bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.228691 Aug 29 21:37:32.691879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 191/382] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:32 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:33.660704 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-323da9dd-6b5f-429b-b755-80b226714665 req-87abc56d-0b88-45da-b3aa-62a1be2a4227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f3dbb7-c3ca-46ab-9903-477493581b37", "name": "network-vif-plugged", "status": "completed", "tag": "9a89d54f-b4bb-438b-aba7-0e6acacc72c3"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:33.672369 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-323da9dd-6b5f-429b-b755-80b226714665 req-87abc56d-0b88-45da-b3aa-62a1be2a4227 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.673319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-323da9dd-6b5f-429b-b755-80b226714665 req-87abc56d-0b88-45da-b3aa-62a1be2a4227 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.673971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-323da9dd-6b5f-429b-b755-80b226714665 req-87abc56d-0b88-45da-b3aa-62a1be2a4227 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.689185 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-323da9dd-6b5f-429b-b755-80b226714665 req-87abc56d-0b88-45da-b3aa-62a1be2a4227 service nova] Creating event network-vif-plugged:9a89d54f-b4bb-438b-aba7-0e6acacc72c3 for instance f3f3dbb7-c3ca-46ab-9903-477493581b37 on hv-cinder-85426 Aug 29 21:37:33.695930 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-323da9dd-6b5f-429b-b755-80b226714665 req-87abc56d-0b88-45da-b3aa-62a1be2a4227 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039993 Aug 29 21:37:33.697042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 192/383] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:33.724643 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:33.725813 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:33.738230 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.740052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.743448 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.744982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.746081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.746884 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.009063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.020692 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.022786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.024560 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-18f42360-6003-415f-948d-8c7aebc2a8fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.304282 Aug 29 21:37:34.025548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 192/384] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:33 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:35.063080 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.063846 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.070223 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.070738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.071184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.071891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.072346 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.072811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.234097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:35.245593 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:35.247819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:35.249054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b10d18ce-a4f8-4a90-afc4-e20b70c8eae6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.191343 Aug 29 21:37:35.249607 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 193/385] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:35 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:35.332678 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.333568 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.343699 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.344522 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.345294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.346402 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.347128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.347837 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.380651 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7465d866-d82c-4f86-a9a3-41f9406a6a9e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1/ips" status: 200 len: 150 microversion: 2.1 time: 0.055275 Aug 29 21:37:35.381237 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 193/386] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:37:35 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:35.393882 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaf24bed-7ea9-480e-a495-b1ca4c0c076e"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:35.396327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.402663 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.403183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.403654 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.404346 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.404839 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.405275 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.510708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Invalid volume: volume aaf24bed-7ea9-480e-a495-b1ca4c0c076e is already attached to instances: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: POST /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1/os-volume_attachments HTTP/1.1 Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 74 Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:37:35.513339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {"volumeAttachment": {"volumeId": "aaf24bed-7ea9-480e-a495-b1ca4c0c076e"}} Aug 29 21:37:35.514947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Invalid volume: volume aaf24bed-7ea9-480e-a495-b1ca4c0c076e is already attached to instances: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'server_id': 'af818bf6-764a-4013-a8f8-44c66e76a0e1', 'body': {'volumeAttachment': {'volumeId': 'aaf24bed-7ea9-480e-a495-b1ca4c0c076e'}}} Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aaf24bed-7ea9-480e-a495-b1ca4c0c076e is already attached to instances: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:37:35.515850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aaf24bed-7ea9-480e-a495-b1ca4c0c076e is already attached to instances: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:35.517907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aaf24bed-7ea9-480e-a495-b1ca4c0c076e is already attached to instances: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 400 to user: Invalid volume: volume aaf24bed-7ea9-480e-a495-b1ca4c0c076e is already attached to instances: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-becae9a3-0ad7-4b0e-b37c-8135d54ab52a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125443 Aug 29 21:37:35.519484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 194/387] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:37:35 2022] POST /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:37:35.527515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.528872 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.538039 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.538524 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.538961 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.539658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.540107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.540689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.561674 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:35.573813 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:37:35.674456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f3790e4a-2a8e-460e-9be9-74ec4e0c488c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 204 len: 0 microversion: 2.1 time: 0.152508 Aug 29 21:37:35.675045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 194/388] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:37:35 2022] DELETE /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:37:35.687222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.688566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.702142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.703039 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.704812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.705116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.705755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.706192 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.712894 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:35.861857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:35.868438 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-55a07daf-038e-4e5a-9598-15fbbdf1ddb6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1681 microversion: 2.1 time: 0.188064 Aug 29 21:37:35.869512 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 195/389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:35 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:36.273718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:36.274550 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:36.282053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.282547 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.283009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.283925 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.284376 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.284856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.445358 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:36.454652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:36.456101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:36.457351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-58a2e5f6-bc2f-42a1-bc33-7b6f41384351 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.188170 Aug 29 21:37:36.457894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 195/390] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:36 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:36.891012 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:36.891912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:36.899169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.899666 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.900162 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.901788 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.901788 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.901987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:37.049927 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.058000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d21efc30-2f72-49a3-813f-d6c60157d7c0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1681 microversion: 2.1 time: 0.171483 Aug 29 21:37:37.058676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 196/391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:36 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:37.481820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:37.483079 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:37.495684 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:37.496727 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:37.498756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:37.499544 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:37.500033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:37.500449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:37.672629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.683118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.686126 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.688465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4964bd1e-c229-4701-8e97-f765eeb0708d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1807 microversion: 2.20 time: 0.210707 Aug 29 21:37:37.690197 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 196/392] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:37 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:38.082469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:38.082469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:38.089785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.091266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.091266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.092031 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.092493 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.093066 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.263692 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:38.279390 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-788bc145-17fa-4d6c-af2c-80c5bf08a485 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1681 microversion: 2.1 time: 0.201298 Aug 29 21:37:38.281806 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 197/393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:38 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:38.717445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:38.718062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:38.724680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.725170 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.725602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.726295 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.726754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.727174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.956091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:38.967166 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:38.968502 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:38.970050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ba99a16f-6dbd-4c9e-81eb-225365e6f147 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1794 microversion: 2.20 time: 0.256822 Aug 29 21:37:38.970657 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 197/394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:38 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1794 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:39.316129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:39.320367 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:39.339665 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.340281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.340870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.341667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.342205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.342700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.363877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-733ef4ec-c121-422a-82a2-97fe6859a100 req-d8a337a1-81f3-4a8e-9310-8f7337fe45be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af818bf6-764a-4013-a8f8-44c66e76a0e1", "name": "network-vif-deleted", "tag": "3e7ea44e-fce2-4487-8d4e-03f6e49c779d"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:39.383998 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-733ef4ec-c121-422a-82a2-97fe6859a100 req-d8a337a1-81f3-4a8e-9310-8f7337fe45be service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.384854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-733ef4ec-c121-422a-82a2-97fe6859a100 req-d8a337a1-81f3-4a8e-9310-8f7337fe45be service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.385614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-733ef4ec-c121-422a-82a2-97fe6859a100 req-d8a337a1-81f3-4a8e-9310-8f7337fe45be service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.398363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-733ef4ec-c121-422a-82a2-97fe6859a100 req-d8a337a1-81f3-4a8e-9310-8f7337fe45be service nova] Creating event network-vif-deleted:3e7ea44e-fce2-4487-8d4e-03f6e49c779d for instance af818bf6-764a-4013-a8f8-44c66e76a0e1 on hv-cinder-85426 Aug 29 21:37:39.415047 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-733ef4ec-c121-422a-82a2-97fe6859a100 req-d8a337a1-81f3-4a8e-9310-8f7337fe45be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055291 Aug 29 21:37:39.416287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 198/395] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:39.744217 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:39.762297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-668b58f4-ec6f-4a0b-80d9-38909a2c291d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 200 len: 1614 microversion: 2.1 time: 0.449807 Aug 29 21:37:39.764043 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 198/396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:39 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 1614 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:40.404146 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:40.407282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:40.415775 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.416287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.417640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.417911 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.420063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.479834 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lazy-loading 'flavor' on Instance uuid 446cfebe-c164-4c5b-8312-67dd13da2898 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:40.704379 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1699bc10-4b12-4e4c-bb54-c89a03fcc602 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/action" status: 200 len: 32 microversion: 2.1 time: 0.305606 Aug 29 21:37:40.705475 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 199/397] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:37:40 2022] POST /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:37:40.717053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:40.718205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:40.723919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.724828 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.725518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.727536 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.727716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.728111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.790776 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:40.791686 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:40.799611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.800117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.800549 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.801310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.802140 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.802564 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.826035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 HTTP/1.1 Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:37:40.828340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:37:40.830700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'af818bf6-764a-4013-a8f8-44c66e76a0e1'} Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:40.831621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:37:40.833427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:40.835042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:40.835042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e453e6b8-257a-4d06-a2cd-4f6589d2479b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 404 len: 111 microversion: 2.1 time: 0.045373 Aug 29 21:37:40.835042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 200/398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:40 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:37:40.842847 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b0379fd5-40cd-4dca-ae8a-72e67298cd66 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '.version_select at 0x7f5402e670d0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:40.849774 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0379fd5-40cd-4dca-ae8a-72e67298cd66 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [2d6e0f3b-3fab-4c4a-b8da-f53ee31e6c1e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 21:37:41.070703 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:41.080738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8ffcd377-3deb-4a6b-a875-9732e6d18236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.369745 Aug 29 21:37:41.081671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 199/399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:40 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:41.857771 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0379fd5-40cd-4dca-ae8a-72e67298cd66 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [2d6e0f3b-3fab-4c4a-b8da-f53ee31e6c1e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47028. Aug 29 21:37:41.880392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b0379fd5-40cd-4dca-ae8a-72e67298cd66 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322869661" status: 202 len: 0 microversion: 2.1 time: 1.042139 Aug 29 21:37:41.881005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 201/400] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 21:37:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322869661 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:37:42.101329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:42.102631 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:42.109244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.109772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.111012 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.111729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.112191 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.112658 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.355477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:42.364194 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9b57a301-81d3-4f53-8159-bff8fdb79969 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.266897 Aug 29 21:37:42.365048 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 200/401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:42 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:42.701033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:42.701536 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:42.707429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.707910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.708343 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.709052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.709507 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.709937 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.843796 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lazy-loading 'services' on Instance uuid d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:42.961843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7b021785-6c3d-4055-a01b-d12c9f26366a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments/aaf24bed-7ea9-480e-a495-b1ca4c0c076e" status: 202 len: 0 microversion: 2.1 time: 0.265645 Aug 29 21:37:42.962838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 202/402] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:37:42 2022] DELETE /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments/aaf24bed-7ea9-480e-a495-b1ca4c0c076e => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:42.971525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:42.973797 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:42.980520 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.981109 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.981572 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.983153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.984393 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.985020 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.024941 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-96746597-521c-4f9e-a817-0736dc384d60 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056665 Aug 29 21:37:43.025595 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 201/403] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:42 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:43.392508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:43.393401 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:43.399770 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.400253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.400729 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.401423 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.401872 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.402294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.546295 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:43.554886 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5af2f43c-2d2e-4f36-a3e5-0e30711e7d34 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.170337 Aug 29 21:37:43.555472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 203/404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:43 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:44.038804 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:44.041903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:44.050109 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.050645 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.051590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.052462 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.053180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.054044 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.103678 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-705b7453-8179-4806-bfff-cd89dd7df37b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069481 Aug 29 21:37:44.104285 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 202/405] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:44 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:37:44.173677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:44.174227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:44.176625 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:44.182148 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.182628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.183059 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.183754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.184783 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.185412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.212461 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:37:44.302368 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e59016fe-becf-4f13-900f-7ad8c142d1f1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 204 len: 0 microversion: 2.1 time: 0.133413 Aug 29 21:37:44.302668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 204/406] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:37:44 2022] DELETE /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:37:44.312560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:44.313255 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:44.321996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.321996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.322595 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.323361 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.323857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.324289 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.472753 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:44.481600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-320ff072-27a9-4046-983e-9cd1f397bbe2 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1682 microversion: 2.1 time: 0.174345 Aug 29 21:37:44.482186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 203/407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:44 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:44.577688 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:44.578357 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:44.584654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.585151 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.585616 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.586323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.586786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.587198 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.760022 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:44.769555 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7c1c7b79-8330-42bc-93a0-d62470ede12d tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.196798 Aug 29 21:37:44.770112 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 205/408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:44 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:45.503915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:45.504439 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:45.510791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.511267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.511694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.512990 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.513440 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.513857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.656641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:45.664760 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c6a3f0fe-ce4f-4f7a-b8f3-105cdd02883a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1682 microversion: 2.1 time: 0.164705 Aug 29 21:37:45.665326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 204/409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:45 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:45.791534 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:45.792134 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:45.799732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.800210 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.800671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.801356 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.801835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.802252 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.938009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:45.947996 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ad520b02-3a2f-412c-a003-1e848bfee7f1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.160179 Aug 29 21:37:45.948576 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 206/410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:45 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:46.686921 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:46.687749 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:46.696652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.696652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.696652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.696652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.697358 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.697358 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.941397 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:46.949400 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f867ad36-f567-4dc5-8c49-3d7f570f01b5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1682 microversion: 2.1 time: 0.266971 Aug 29 21:37:46.950566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 205/411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:46 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:46.969532 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:46.970085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:46.976441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.976953 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.977433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.978128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.978623 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.978989 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.994217 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:47.212992 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:47.221837 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3ead34e3-993e-4e95-98a2-fe54dd65e7d3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.256626 Aug 29 21:37:47.222640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 207/412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:46 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:47.437688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-b9990739-2100-4e01-b625-76578fb14e48 req-8019b6ba-2f67-47cf-ae06-5bb43d489c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57", "name": "network-vif-deleted", "tag": "2585b07b-9d0b-4988-b1c6-a7489aea0806"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:47.445073 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=42 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:47.454481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-b9990739-2100-4e01-b625-76578fb14e48 req-8019b6ba-2f67-47cf-ae06-5bb43d489c69 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.454974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-b9990739-2100-4e01-b625-76578fb14e48 req-8019b6ba-2f67-47cf-ae06-5bb43d489c69 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.455406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-b9990739-2100-4e01-b625-76578fb14e48 req-8019b6ba-2f67-47cf-ae06-5bb43d489c69 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.468836 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-b9990739-2100-4e01-b625-76578fb14e48 req-8019b6ba-2f67-47cf-ae06-5bb43d489c69 service nova] Creating event network-vif-deleted:2585b07b-9d0b-4988-b1c6-a7489aea0806 for instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 on hv-cinder-85426 Aug 29 21:37:47.478165 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-b9990739-2100-4e01-b625-76578fb14e48 req-8019b6ba-2f67-47cf-ae06-5bb43d489c69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046044 Aug 29 21:37:47.478997 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 206/413] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:47.971184 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:47.972423 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.978792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.979286 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.979724 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.980417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.981537 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.981982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.014464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.014955 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.015398 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.015917 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lazy-loading 'fault' on Instance uuid d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:48.065891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.074029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-096a32b5-7dc1-4c01-b25d-c5355b523a29 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 200 len: 1332 microversion: 2.1 time: 0.106840 Aug 29 21:37:48.074652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 208/414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:47 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:48.250126 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:48.251877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:48.262600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.262600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.262600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.263414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.263414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.265064 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.421418 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.433802 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a9bc19a3-e565-4d0e-93d2-3cbfdd8b6bf4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.192922 Aug 29 21:37:48.434419 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 207/415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:48 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:49.097167 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:49.097708 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:49.104416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.104936 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.105377 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.106068 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.106527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.106952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.121003 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 HTTP/1.1 Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:37:49.123411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:37:49.125043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'd7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57'} Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:49.125929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:37:49.127391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:37:49.128805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:49.128805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a3cedc1a-6d6a-4d87-9c3d-46a8734ab9db tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 404 len: 111 microversion: 2.1 time: 0.031944 Aug 29 21:37:49.128805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 209/416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:49 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:37:49.134026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b043d3bf-3f09-4ae0-9fbf-a129528a8745 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '.version_select at 0x7f5402c985e0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:49.157283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b043d3bf-3f09-4ae0-9fbf-a129528a8745 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113280811" status: 202 len: 0 microversion: 2.1 time: 0.026746 Aug 29 21:37:49.157980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 208/417] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 21:37:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113280811 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:37:49.461345 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:49.461971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:49.468980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.469474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.469908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.470632 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.471086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.471515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.710525 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:49.719828 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d55cf449-4455-416b-9564-0c6961567542 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.264234 Aug 29 21:37:49.720413 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 210/418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:49 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:49.954184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-861a1cd9-1f4e-4ef7-b78a-63684467a02a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: .version_select at 0x7f5402e39f70>, body: {"keypair": {"name": "tempest-keypair-517502363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFobdHwNXaJKa37n3DsY8ot9QjANxE+avVCVpFYp/uNhhL0i57FomB4WMtoc8G9Kuc5t8nhTnMDqA3xgbQgRDfvVOqpv90DtjXfqCy44lmqxkFwPTzw3wGCrP0BnuzthUg=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:49.972932 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-861a1cd9-1f4e-4ef7-b78a-63684467a02a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:37:49.976841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-861a1cd9-1f4e-4ef7-b78a-63684467a02a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:37:50.002236 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-861a1cd9-1f4e-4ef7-b78a-63684467a02a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054010 Aug 29 21:37:50.002841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 209/419] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:37:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:50.751037 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:50.752194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:50.764307 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.765252 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.766000 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.767470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.768331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.769323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:51.025849 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:51.036201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-de9d0b08-0d3b-4cd3-9f1f-de7bd7609fb5 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.292690 Aug 29 21:37:51.036819 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 211/420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:50 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:51.561092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1726794673", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5edf4d12-91b6-4448-8d9a-6fbab4fee15a"}], "security_groups": [{"name": "tempest-securitygroup--1830597584"}], "key_name": "tempest-keypair-517502363", "user_data": "}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:51.684778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] validate_networks() for [('5edf4d12-91b6-4448-8d9a-6fbab4fee15a', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:37:52.063829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:52.065034 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:52.078743 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.079548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.080360 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.081756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.082677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.083499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.136422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:37:52.137629 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:37:52.138410 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:37:52.139070 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:37:52.139646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:37:52.151213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.151802 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.152306 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.153199 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.153761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.154288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.174377 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:37:52.179731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:37:52.196394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:37:52.198810 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:37:52.253199 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-274b9f31-4ad8-4983-9b9c-d0832fec6be8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.698632 Aug 29 21:37:52.254242 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 210/421] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:37:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:37:52.267265 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0791bb4f-00ed-4bb1-ae0e-fa088cafc8c7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:52.267960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0791bb4f-00ed-4bb1-ae0e-fa088cafc8c7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:52.301261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.311337 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-faabad7e-bb05-4bc4-aeb7-3abf82550f2b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.255547 Aug 29 21:37:52.326982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 212/422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:52 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:52.353175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0791bb4f-00ed-4bb1-ae0e-fa088cafc8c7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.360667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0791bb4f-00ed-4bb1-ae0e-fa088cafc8c7 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1241 microversion: 2.1 time: 0.098715 Aug 29 21:37:52.361427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 211/423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:52 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:53.333603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:53.334212 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:53.340549 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.341061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.341493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.342178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.342632 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.343057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.381832 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:53.382492 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:53.389183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.389670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.390119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.390828 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.391550 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.391977 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.469017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:53.476779 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9cc66fe1-d007-4686-b51f-a0da7ca70ab3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1293 microversion: 2.1 time: 0.098798 Aug 29 21:37:53.477398 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 212/424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:53 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:53.500947 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:53.510830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c377fdd5-2d71-4c7f-b3cb-8daa3b72314b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.180905 Aug 29 21:37:53.511814 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 213/425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:53 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:54.500036 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:54.500800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:54.507352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.507834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.508266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.509187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.509649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.510067 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.538429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:54.539994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:54.547175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.547788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.548231 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.549061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.549521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.550142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.586034 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.595549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-afc4b0ff-73d7-4c65-b205-f088cb345e10 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1299 microversion: 2.1 time: 0.100091 Aug 29 21:37:54.596230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 213/426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:54 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:54.803011 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.811453 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e6971686-b8af-4e74-a20d-d2fb625626e1 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.277269 Aug 29 21:37:54.819950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 214/427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:54 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:55.423290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-4c37b02f-952f-4558-a3aa-b44f2525e706 req-7db2ae70-251d-4e5c-9423-261756f4a0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d22285-60c9-4602-aa73-9cfac08e8497", "tag": "66d1d8cf-a6b7-4912-a40d-0d03daba0a3c"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:55.435473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-4c37b02f-952f-4558-a3aa-b44f2525e706 req-7db2ae70-251d-4e5c-9423-261756f4a0f0 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.435869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-4c37b02f-952f-4558-a3aa-b44f2525e706 req-7db2ae70-251d-4e5c-9423-261756f4a0f0 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.436497 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-4c37b02f-952f-4558-a3aa-b44f2525e706 req-7db2ae70-251d-4e5c-9423-261756f4a0f0 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.450239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-4c37b02f-952f-4558-a3aa-b44f2525e706 req-7db2ae70-251d-4e5c-9423-261756f4a0f0 service nova] Creating event network-changed:66d1d8cf-a6b7-4912-a40d-0d03daba0a3c for instance c3d22285-60c9-4602-aa73-9cfac08e8497 on hv-cinder-85426 Aug 29 21:37:55.456726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-4c37b02f-952f-4558-a3aa-b44f2525e706 req-7db2ae70-251d-4e5c-9423-261756f4a0f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036529 Aug 29 21:37:55.458664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 214/428] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:55.620207 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:55.623003 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:55.630317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.630798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.631267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.631983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.632439 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.632982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.836130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:55.836983 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:55.844838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.845442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.845905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.846649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.847140 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.847589 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.860277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:55.867041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-93f08ab0-eb2c-45cc-9e79-b72c11f8d09e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1367 microversion: 2.1 time: 0.252893 Aug 29 21:37:55.867735 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 215/429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:55 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:56.068413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:56.076622 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4ed106b0-1183-4f76-8bc9-171b9b971ad7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.244850 Aug 29 21:37:56.077183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 215/430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:55 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:56.889269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:56.890653 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:56.898429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.898917 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.899355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.900061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.900521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.900970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.039044 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.047730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-338636c5-0d9b-48bb-9cc9-45f646647c91 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1367 microversion: 2.1 time: 0.163243 Aug 29 21:37:57.048601 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 216/431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:56 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:57.098237 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:57.099544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:57.106706 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.107187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.107623 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.108305 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.108889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.109426 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.271768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.274167 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=100 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:57.283427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b5e2e254-5463-483a-b9d5-d56a2d90d7d0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.189036 Aug 29 21:37:57.289556 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 216/432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:57 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:57.877136 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:57.877628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:57.883841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.884338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.884810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.885509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.886165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.886600 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.978258 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lazy-loading 'services' on Instance uuid 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:58.061027 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7c0d9078-385f-46fe-b650-a421307c2bb0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-volume_attachments/e8c2a6a4-0779-4224-9f02-9e9623b4ac77" status: 202 len: 0 microversion: 2.1 time: 0.187538 Aug 29 21:37:58.061630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 217/433] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:37:57 2022] DELETE /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-volume_attachments/e8c2a6a4-0779-4224-9f02-9e9623b4ac77 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:58.071615 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:58.072495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:58.080479 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.081317 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.081916 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.082798 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.083260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.083687 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.310396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:58.314485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:58.317905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:58.327382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ec7cbefb-cbb9-4437-8187-a5b1015362ff tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1367 microversion: 2.1 time: 0.256865 Aug 29 21:37:58.328054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 217/434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:58 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:58.341594 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.342457 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.343069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.344072 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.344660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.345170 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.485096 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:58.493888 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d3da9ba3-94ee-4c58-9fc6-0cebf3276a0a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.191821 Aug 29 21:37:58.494563 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 218/435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:58 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:59.220800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c7130160-6776-480a-ac42-4e3869b23b1a tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:59.227342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7130160-6776-480a-ac42-4e3869b23b1a tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.227823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7130160-6776-480a-ac42-4e3869b23b1a tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.228250 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7130160-6776-480a-ac42-4e3869b23b1a tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.251589 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c7130160-6776-480a-ac42-4e3869b23b1a tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Going to try to stop instance {{(pid=127216) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:37:59.302059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c7130160-6776-480a-ac42-4e3869b23b1a tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.085486 Aug 29 21:37:59.303238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 218/436] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:37:59 2022] POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:59.312346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:59.315081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:59.327055 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.327943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.328661 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.329882 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.330356 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.330787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.348761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:59.351082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:59.358942 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.359429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.360021 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.360754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.361255 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.361934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.556620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.566762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.575006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-08f9520d-a97e-4046-b876-ada0221457d9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1367 microversion: 2.1 time: 0.230404 Aug 29 21:37:59.575618 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 219/437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:59 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:59.581358 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8ceb1cff-5dd0-4471-a005-f709128a1b28 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.273931 Aug 29 21:37:59.581938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 219/438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:59 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:59.583609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:59.584221 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:59.590554 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.591603 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.592140 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.593123 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.593596 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.595193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.757116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.767930 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-464a56fa-8f24-4362-87a3-2990f2128c96 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.191047 Aug 29 21:37:59.768463 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 220/439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:59 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:59.817088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-8466c30f-eb7c-4a9c-a563-cc4469d874fa req-2e79415e-322d-4961-a00f-f30cfa1bf02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d22285-60c9-4602-aa73-9cfac08e8497", "name": "network-vif-plugged", "status": "completed", "tag": "66d1d8cf-a6b7-4912-a40d-0d03daba0a3c"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:59.827348 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-8466c30f-eb7c-4a9c-a563-cc4469d874fa req-2e79415e-322d-4961-a00f-f30cfa1bf02b service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.827901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-8466c30f-eb7c-4a9c-a563-cc4469d874fa req-2e79415e-322d-4961-a00f-f30cfa1bf02b service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.828339 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-8466c30f-eb7c-4a9c-a563-cc4469d874fa req-2e79415e-322d-4961-a00f-f30cfa1bf02b service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.840409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-8466c30f-eb7c-4a9c-a563-cc4469d874fa req-2e79415e-322d-4961-a00f-f30cfa1bf02b service nova] Creating event network-vif-plugged:66d1d8cf-a6b7-4912-a40d-0d03daba0a3c for instance c3d22285-60c9-4602-aa73-9cfac08e8497 on hv-cinder-85426 Aug 29 21:37:59.845731 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-8466c30f-eb7c-4a9c-a563-cc4469d874fa req-2e79415e-322d-4961-a00f-f30cfa1bf02b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Aug 29 21:37:59.846334 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 220/440] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:00.598131 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:00.598741 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:00.605761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.606059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.606208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:00.606700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.606816 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:00.607211 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.607645 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.608065 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.613250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.613746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.614364 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.615111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.615569 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.615996 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.815327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.823780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4c29f561-cf9e-4c7e-9e5c-f76ba7503d1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1367 microversion: 2.1 time: 0.229414 Aug 29 21:38:00.824937 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.825080 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 221/441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:00 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:00.829565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:00.830182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:00.836566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.837089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.837529 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.837812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c029a494-f93f-4ac6-a8e4-75d19f9f57eb tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.236896 Aug 29 21:38:00.838243 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.838696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.839274 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 221/442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:00 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:00.839411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.978720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.990275 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8f3f1599-374a-4530-bf9c-cf6dcab486db tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.164294 Aug 29 21:38:00.991061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 222/443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:00 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:01.845256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:01.845871 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:01.852226 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.852751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.853186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.853882 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.854334 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.854751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.868793 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:01.869872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:01.878373 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.879374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.880166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.881083 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.881702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.882234 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.061504 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:02.069141 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-aa7a264c-a41c-4a1b-8d19-fb53e691778f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1557 microversion: 2.1 time: 0.227567 Aug 29 21:38:02.069730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 222/444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:01 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1557 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:02.074234 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:02.074846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:02.080607 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.081279 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.081928 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.082741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.083464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.083903 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.086256 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:02.094595 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-be5bdc27-da3b-40de-9815-da3f44b5d634 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.231798 Aug 29 21:38:02.095346 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 223/445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:01 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:02.100549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:02.101227 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:02.107694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.108388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.109010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.109696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.110238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.110660 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.161813 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:02.231533 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-fa1ef6af-2999-48a4-9122-02e2cec33895 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134489 Aug 29 21:38:02.232125 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 224/446] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:38:02 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:02.272102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:02.281566 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f880f5e4-20fb-45b5-a617-70cd0b51e7c0 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.210630 Aug 29 21:38:02.282306 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 223/447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:02 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:03.114447 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=12 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:03.120803 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:03.121921 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:03.129955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.130457 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.131139 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.131852 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.132312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.132766 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.302593 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.306789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:03.307605 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:03.311514 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-027ac316-e1aa-491d-9e57-adaa05b53170 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.198269 Aug 29 21:38:03.312805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 225/448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:03 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:03.321738 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.322246 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.322888 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.323609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.327105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.327561 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.348161 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:03.520121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.533835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-accc39a2-f16e-4800-bf0f-9fb5dd632343 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.232166 Aug 29 21:38:03.534141 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-2ac4bbb7-ca88-405d-aa84-9ea22fa60dd2 req-3e6ceec5-7800-4110-972e-e2e6c95e4f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d22285-60c9-4602-aa73-9cfac08e8497", "tag": "66d1d8cf-a6b7-4912-a40d-0d03daba0a3c"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:03.534578 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 224/449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:03 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:03.544014 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-2ac4bbb7-ca88-405d-aa84-9ea22fa60dd2 req-3e6ceec5-7800-4110-972e-e2e6c95e4f2c service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.544494 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-2ac4bbb7-ca88-405d-aa84-9ea22fa60dd2 req-3e6ceec5-7800-4110-972e-e2e6c95e4f2c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.544951 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-2ac4bbb7-ca88-405d-aa84-9ea22fa60dd2 req-3e6ceec5-7800-4110-972e-e2e6c95e4f2c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.560345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-2ac4bbb7-ca88-405d-aa84-9ea22fa60dd2 req-3e6ceec5-7800-4110-972e-e2e6c95e4f2c service nova] Creating event network-changed:66d1d8cf-a6b7-4912-a40d-0d03daba0a3c for instance c3d22285-60c9-4602-aa73-9cfac08e8497 on hv-cinder-85426 Aug 29 21:38:03.565702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-2ac4bbb7-ca88-405d-aa84-9ea22fa60dd2 req-3e6ceec5-7800-4110-972e-e2e6c95e4f2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036307 Aug 29 21:38:03.566298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 226/450] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:04.341678 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:04.342287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:04.353333 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.354268 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.355397 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.355756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.356300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.357166 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.571964 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:04.573290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:04.579708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.580498 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.586326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.587089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.587561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.588357 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.622572 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:04.632644 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-aba75204-0d95-416a-815c-b04d63b54571 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.295557 Aug 29 21:38:04.633237 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 225/451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:04 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:04.757027 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:04.765726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-be387241-81ef-4fda-bd47-00b281417700 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.198205 Aug 29 21:38:04.766669 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 227/452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:04 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:05.657166 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:05.658368 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:05.665589 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.666305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.667028 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.668654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.669287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.669712 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.788783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:05.789396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:05.797264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.797264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.798186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.798912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.799380 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.799811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.038693 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:06.049943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-548c198b-d02e-4443-9b31-6805ece8361e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.396661 Aug 29 21:38:06.056820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 226/453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:05 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:06.083947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:06.093495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f0d8f1ec-a025-4b8d-9a04-d44cb3904da4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.308407 Aug 29 21:38:06.093890 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 228/454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:05 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:07.071202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:07.071845 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:07.078933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.079402 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.079835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.080534 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.081024 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.081447 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.116129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:07.116899 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:07.127006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.127498 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.128187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.128938 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.129394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.129815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.269094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:07.277658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d2704bed-8099-42c9-a5ea-136158fba412 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.210226 Aug 29 21:38:07.278501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 227/455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:07 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:07.298765 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:07.307029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3ea1c4b3-f973-4b26-ba0c-c815678d1551 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1735 microversion: 2.1 time: 0.195229 Aug 29 21:38:07.307595 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 229/456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:07 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:08.298859 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:08.299464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:08.305860 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.306347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.306781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.307468 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.307921 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.308863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.329592 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:08.330202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:08.337819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.338305 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.338738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.339432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.339885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.340308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.734065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:08.741784 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2d35f4bb-1277-4ff9-abfa-6e24785c161d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1679 microversion: 2.1 time: 0.446733 Aug 29 21:38:08.742352 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 228/457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:08 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1679 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:08.748034 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:08.756562 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7dded504-2437-4c72-801c-3b8087128590 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1715 microversion: 2.1 time: 0.430833 Aug 29 21:38:08.757151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 230/458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:08 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1715 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:08.882913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:08.883407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:08.889501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.889985 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.890403 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.891354 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.891806 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.892228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.977354 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] HTTP exception thrown: Cannot 'detach_volume' instance 446cfebe-c164-4c5b-8312-67dd13da2898 while it is in vm_state rescued Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Request method failure captured: Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: DELETE /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments/4b76469e-5342-40cb-b999-f13d2bbf6579 HTTP/1.1 Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZcJayaPMiVvOdb4QlD1aS9Nlrx6Ud6omWvPEIlFcBGr68ocnfX4OqlkiAD4SgTPp40rgWrvvVdXEKuKJV0IyMWnMNUyRa67hjywKRHUH9PKNHVT8hJ4qmm9XZYQ-vQMdzneL75fqS0xSfG_h0RCKaRx3ndFEnNDSuqeAe22J-D5c Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:38:08.978950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57c7abc43eb142d3b36a6d91beee5d10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 5344cf7b391d44beac2c602ac3e2e64b Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:38:08.980952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Cannot 'detach_volume' instance 446cfebe-c164-4c5b-8312-67dd13da2898 while it is in vm_state rescued Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'server_id': '446cfebe-c164-4c5b-8312-67dd13da2898', 'id': '4b76469e-5342-40cb-b999-f13d2bbf6579'} Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 446cfebe-c164-4c5b-8312-67dd13da2898 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:08.982282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 446cfebe-c164-4c5b-8312-67dd13da2898 while it is in vm_state rescued Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 446cfebe-c164-4c5b-8312-67dd13da2898 while it is in vm_state rescued Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:08.983970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Returning 409 to user: Cannot 'detach_volume' instance 446cfebe-c164-4c5b-8312-67dd13da2898 while it is in vm_state rescued {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:08.985168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-03e418e7-25fe-4de4-a970-4fe983ad8bad tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments/4b76469e-5342-40cb-b999-f13d2bbf6579" status: 409 len: 152 microversion: 2.1 time: 0.101455 Aug 29 21:38:08.985168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 229/459] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:38:08 2022] DELETE /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments/4b76469e-5342-40cb-b999-f13d2bbf6579 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:38:08.990103 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:08.990636 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:08.996983 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.997469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.997906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.998600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.999865 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.999865 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:09.068849 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e2b92701-69a5-4f5e-9995-ed5871f099f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "POST /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/action" status: 202 len: 0 microversion: 2.1 time: 0.082047 Aug 29 21:38:09.072851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 231/460] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:38:08 2022] POST /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:38:09.084774 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:09.085386 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:09.092565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:09.093077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:09.093515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:09.094221 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:09.094704 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:09.095122 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:09.307029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:09.328045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d6dd8740-2b29-4a79-894d-2feb3f29dceb tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1723 microversion: 2.1 time: 0.246875 Aug 29 21:38:09.328472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 230/461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:09 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:09.765308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:09.766420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:09.773153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:09.773926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:09.774369 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:09.775084 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:09.775550 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:09.776014 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:09.798900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:09.948482 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:09.959170 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e9450d78-eb1e-4fe9-ad58-292520dd3572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1656 microversion: 2.1 time: 0.199380 Aug 29 21:38:09.959747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 232/462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:09 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1656 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:09.980431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4020b04a-5ec7-41fd-b86e-41ffe97f8a27 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:09.986562 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4020b04a-5ec7-41fd-b86e-41ffe97f8a27 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:09.987047 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4020b04a-5ec7-41fd-b86e-41ffe97f8a27 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:09.987479 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4020b04a-5ec7-41fd-b86e-41ffe97f8a27 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.010527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4020b04a-5ec7-41fd-b86e-41ffe97f8a27 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Going to try to start instance {{(pid=127217) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:38:10.061833 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4020b04a-5ec7-41fd-b86e-41ffe97f8a27 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.085113 Aug 29 21:38:10.062427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 231/463] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:38:09 2022] POST /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:38:10.073838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:10.074397 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:10.081662 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.082146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.082590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.083279 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.083842 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.084264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.222667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:10.232633 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ba60631a-9a71-4e19-a364-851640c486d8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1665 microversion: 2.1 time: 0.164469 Aug 29 21:38:10.233210 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 233/464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:10 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:10.351645 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:10.352332 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:10.361153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.361521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.361949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.362649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.363097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.363518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.500165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:10.508705 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-044b8640-49e4-4fbf-9db5-1ac83f5eb3e4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1723 microversion: 2.1 time: 0.162200 Aug 29 21:38:10.509281 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 232/465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:10 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:11.254904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:11.255454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:11.262597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.263088 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.263524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.264231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.264719 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.265154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.415385 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:11.423350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c1745374-e8f7-41af-baa5-1f362d3d809d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1665 microversion: 2.1 time: 0.172407 Aug 29 21:38:11.423938 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 234/466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:11 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:11.530229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:11.530948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:11.538769 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.539317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.539703 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.540409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.540914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.541362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.699728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:11.707863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e3a7e469-46ec-4d99-8417-de641a0967ef tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1723 microversion: 2.1 time: 0.181528 Aug 29 21:38:11.708438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 233/467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:11 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:12.445203 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:12.445932 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:12.453091 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.453580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.454017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.454719 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.455178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.455599 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.693316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:12.701778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d4cdcac4-d551-4877-84de-506412267045 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1665 microversion: 2.1 time: 0.260311 Aug 29 21:38:12.702363 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 235/468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:12 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1665 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:12.731395 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:12.732003 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:12.739005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.739718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.740270 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.741004 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.741463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.742552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.923922 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:12.932323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ee556560-16a3-480e-891f-eef5f073ece3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1729 microversion: 2.1 time: 0.204870 Aug 29 21:38:12.933492 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 234/469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:12 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:12.954148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:12.954565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:12.960455 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.960972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.961403 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.962086 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.962542 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.962965 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.041355 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6a227fbf-2eb1-4634-9ab0-40e32ee7b7e7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091264 Aug 29 21:38:13.041950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 236/470] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:38:12 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:13.724319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:13.725080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:13.732168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.733227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.733227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.734084 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.734949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.736033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.889089 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:13.905904 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5c28a8cf-4801-439b-ac99-a3b885f24663 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1669 microversion: 2.1 time: 0.185758 Aug 29 21:38:13.906490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 235/471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:13 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1669 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:13.994649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-38b02c03-61a5-4c60-89e0-9751cd41f102 req-38e9e6e7-0d39-4938-a9f5-5c10a72afaac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446cfebe-c164-4c5b-8312-67dd13da2898", "tag": "d6330450-f0d1-4063-9b9d-1477fa88871b"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:14.007979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-38b02c03-61a5-4c60-89e0-9751cd41f102 req-38e9e6e7-0d39-4938-a9f5-5c10a72afaac service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:14.007979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-38b02c03-61a5-4c60-89e0-9751cd41f102 req-38e9e6e7-0d39-4938-a9f5-5c10a72afaac service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:14.007979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-38b02c03-61a5-4c60-89e0-9751cd41f102 req-38e9e6e7-0d39-4938-a9f5-5c10a72afaac service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:14.020837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-38b02c03-61a5-4c60-89e0-9751cd41f102 req-38e9e6e7-0d39-4938-a9f5-5c10a72afaac service nova] Creating event network-changed:d6330450-f0d1-4063-9b9d-1477fa88871b for instance 446cfebe-c164-4c5b-8312-67dd13da2898 on hv-cinder-85426 Aug 29 21:38:14.026320 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-38b02c03-61a5-4c60-89e0-9751cd41f102 req-38e9e6e7-0d39-4938-a9f5-5c10a72afaac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035220 Aug 29 21:38:14.027843 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 237/472] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:16.041900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-3e5fbb4c-059b-4483-9c25-5b51ae203bea req-38726d60-ae60-4613-bd65-e229a26897bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446cfebe-c164-4c5b-8312-67dd13da2898", "tag": "d6330450-f0d1-4063-9b9d-1477fa88871b"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:16.047981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:16.057151 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-3e5fbb4c-059b-4483-9c25-5b51ae203bea req-38726d60-ae60-4613-bd65-e229a26897bf service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.057625 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-3e5fbb4c-059b-4483-9c25-5b51ae203bea req-38726d60-ae60-4613-bd65-e229a26897bf service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.058054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-3e5fbb4c-059b-4483-9c25-5b51ae203bea req-38726d60-ae60-4613-bd65-e229a26897bf service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.069428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-3e5fbb4c-059b-4483-9c25-5b51ae203bea req-38726d60-ae60-4613-bd65-e229a26897bf service nova] Creating event network-changed:d6330450-f0d1-4063-9b9d-1477fa88871b for instance 446cfebe-c164-4c5b-8312-67dd13da2898 on hv-cinder-85426 Aug 29 21:38:16.075616 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-3e5fbb4c-059b-4483-9c25-5b51ae203bea req-38726d60-ae60-4613-bd65-e229a26897bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036708 Aug 29 21:38:16.075616 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 236/473] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:28.059580 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.061381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=27 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.068702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:28.069546 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:28.083528 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.084264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.084989 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.086060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.086750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.087372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.122719 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d92fcb5d-7ef6-4839-95c3-602b1108ef17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments/11fd2f45-987a-48f9-92c8-f9b934089f40" status: 200 len: 194 microversion: 2.20 time: 0.066529 Aug 29 21:38:28.123319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 238/474] 10.222.0.20 () {60 vars in 1454 bytes} [Mon Aug 29 21:38:28 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments/11fd2f45-987a-48f9-92c8-f9b934089f40 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:38:28.191178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.191916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.196698 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:28.197277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:28.205215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.205696 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.206123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.206811 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.207263 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.207676 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.289873 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lazy-loading 'services' on Instance uuid f3f3dbb7-c3ca-46ab-9903-477493581b37 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:28.365560 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-621fe3da-2686-44d8-82ad-67f163cc5aa6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments/11fd2f45-987a-48f9-92c8-f9b934089f40" status: 202 len: 0 microversion: 2.20 time: 0.175850 Aug 29 21:38:28.366159 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 237/475] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 29 21:38:28 2022] DELETE /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments/11fd2f45-987a-48f9-92c8-f9b934089f40 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:38:28.376866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:28.379243 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:28.385768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.386250 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.386739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.387452 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.387920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.388403 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.422894 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c7056258-dd0c-4e3c-937a-aa866f6d77f1 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050564 Aug 29 21:38:28.423464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 239/476] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 21:38:28 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:38:29.436984 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:29.439262 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:29.445834 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.446322 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.446784 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.447476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.447929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.448956 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.478813 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-37e276ce-a184-4bfc-99a1-a62f71aba29f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047117 Aug 29 21:38:29.479453 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 238/477] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 21:38:29 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:29.544136 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:29.544728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:29.554206 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.554960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.555648 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.556826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.558060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.558762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.588849 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:38:29.685018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cfe78511-969a-4031-bca7-75adc6bf1ccc tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 204 len: 0 microversion: 2.20 time: 0.144264 Aug 29 21:38:29.685700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 240/478] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 21:38:29 2022] DELETE /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:38:29.695166 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:29.695778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:29.702061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.702590 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.703029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.703716 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.704179 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.704621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.841333 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:29.855705 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:29.857219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:29.858395 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0740ee8c-5d24-436d-8b6b-4bf78960ec6b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.167616 Aug 29 21:38:29.858954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 239/479] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:29 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:30.882700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:30.883586 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:30.890238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.890984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.891433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.892155 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.892635 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.893076 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.043651 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:31.053540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:31.053872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:31.055068 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d02f0356-9113-4354-a32d-b0f4069d4d72 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1722 microversion: 2.20 time: 0.176880 Aug 29 21:38:31.055637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 241/480] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:30 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:38:32.084647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:32.085967 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:32.093380 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.094168 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.094665 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.095370 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.095824 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.096327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.192864 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:32.204461 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:32.209300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:32.210935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-684f2210-892a-422b-b787-6b1471a1d751 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1655 microversion: 2.20 time: 0.131829 Aug 29 21:38:32.212314 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 240/481] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:32 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1655 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:32.748972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-712d3b0a-79c5-4a4c-b5c6-aeaa205ab05a req-27361037-744f-46f3-b39a-63387f868da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f3dbb7-c3ca-46ab-9903-477493581b37", "name": "network-vif-deleted", "tag": "9a89d54f-b4bb-438b-aba7-0e6acacc72c3"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:32.762576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-712d3b0a-79c5-4a4c-b5c6-aeaa205ab05a req-27361037-744f-46f3-b39a-63387f868da1 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.763287 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-712d3b0a-79c5-4a4c-b5c6-aeaa205ab05a req-27361037-744f-46f3-b39a-63387f868da1 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.763720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-712d3b0a-79c5-4a4c-b5c6-aeaa205ab05a req-27361037-744f-46f3-b39a-63387f868da1 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.777668 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-712d3b0a-79c5-4a4c-b5c6-aeaa205ab05a req-27361037-744f-46f3-b39a-63387f868da1 service nova] Creating event network-vif-deleted:9a89d54f-b4bb-438b-aba7-0e6acacc72c3 for instance f3f3dbb7-c3ca-46ab-9903-477493581b37 on hv-cinder-85426 Aug 29 21:38:32.784851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-712d3b0a-79c5-4a4c-b5c6-aeaa205ab05a req-27361037-744f-46f3-b39a-63387f868da1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038917 Aug 29 21:38:32.785389 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 242/482] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:33.235998 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:33.236811 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:33.243192 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.243970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.244601 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.245990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.246682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.247276 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.288346 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.289288 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.290141 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.290980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lazy-loading 'fault' on Instance uuid f3f3dbb7-c3ca-46ab-9903-477493581b37 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:33.343302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:33.361767 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:33.364615 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:33.366914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-22e52dec-b857-4c25-bef2-ffe5c9961417 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 200 len: 1371 microversion: 2.20 time: 0.135808 Aug 29 21:38:33.367866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 241/483] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:33 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:34.396950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:34.397688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:34.405305 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.405789 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.406277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.407068 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.407541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.407936 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.424402 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] HTTP exception thrown: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Request method failure captured: Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 HTTP/1.1 Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDfOByAvK9vpU0vB1gZeiqtEwxuW3F3MCpJh-99oZHnm4l34899V6bWuRsqn2OAVZ7zKB26cSf2moHEhmTrUbNqv6hEktJ_NRt05rwbXnEp-PwF8Ou2qHSqHBiTZEjF2iHs8ltuqu6VuQnsD35GH2EsbhRILjT_HrxpPovqwpzzgcg Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:38:34.426691 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09369e28336d4f49a60ce03c3a3009ac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 55a5c6359109440fbb66d985fafc24bf Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:38:34.429332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'f3f3dbb7-c3ca-46ab-9903-477493581b37'} Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:34.430671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:38:34.433544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:38:34.435725 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Returning 404 to user: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:34.435725 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b2e110c0-1ac3-4815-b1f3-f3dd761ac371 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 404 len: 111 microversion: 2.20 time: 0.038768 Aug 29 21:38:34.435725 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 243/484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:34 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:38:34.440171 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bb737099-33ff-4fdc-9295-ab247d85b23f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '.version_select at 0x7f5402ad5310>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:34.468829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bb737099-33ff-4fdc-9295-ab247d85b23f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178746993" status: 204 len: 0 microversion: 2.20 time: 0.032575 Aug 29 21:38:34.469567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 242/485] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 29 21:38:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178746993 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:38:35.180622 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8a8f198c-9047-450f-91a5-eb06bfaec2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'create', calling method: .version_select at 0x7f5402c6bd30>, body: {"keypair": {"name": "tempest-keypair-1448550884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC391UNaPcaAzSsZCzjrC7PZUVyeLEQKE4qe23xN1r9sFemJ78X6B4SfHWFU9uCLXbPLUCWoa3PoJJSKNzjG0KX1j6KEagyCxSsusXsPstQY3SuvDtoa2RhH5f8ciGBQQQ=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:35.196797 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-8a8f198c-9047-450f-91a5-eb06bfaec2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:38:35.200704 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-8a8f198c-9047-450f-91a5-eb06bfaec2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for user 55a5c6359109440fbb66d985fafc24bf and project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:38:35.224265 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8a8f198c-9047-450f-91a5-eb06bfaec2f3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047612 Aug 29 21:38:35.224919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 244/486] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 21:38:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 21:38:36.547124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2008893180", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbee627c-5d5c-4780-b2d4-43c7e4d208fc"}], "security_groups": [{"name": "tempest-securitygroup--2038648115"}], "key_name": "tempest-keypair-1448550884", "user_data": "}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:36.650735 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] validate_networks() for [('bbee627c-5d5c-4780-b2d4-43c7e4d208fc', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:38:37.030360 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:38:37.030781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:38:37.031269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:38:37.031674 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:38:37.032084 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:38:37.040974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:37.041529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:37.042477 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:37.043191 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:37.043640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:37.044057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:37.060269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:38:37.064135 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Getting quotas for user 55a5c6359109440fbb66d985fafc24bf and project 09369e28336d4f49a60ce03c3a3009ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:38:37.075416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:38:37.077706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:38:37.125800 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR oslo.messaging._drivers.impl_rabbit [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [65f4305b-c01b-4187-bf21-193e42620631] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 21:38:38.134735 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO oslo.messaging._drivers.impl_rabbit [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [65f4305b-c01b-4187-bf21-193e42620631] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47506. Aug 29 21:38:38.140080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-130d8c58-1f45-442a-975d-5bb061ee91a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.598266 Aug 29 21:38:38.141218 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 243/487] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 21:38:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 21:38:38.153151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-62c80c07-5e13-4d06-a5bd-a3aad516da17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:38.153751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-62c80c07-5e13-4d06-a5bd-a3aad516da17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:38.212351 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-62c80c07-5e13-4d06-a5bd-a3aad516da17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:38.221177 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-62c80c07-5e13-4d06-a5bd-a3aad516da17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:38.222722 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-62c80c07-5e13-4d06-a5bd-a3aad516da17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:38.224165 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-62c80c07-5e13-4d06-a5bd-a3aad516da17 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1282 microversion: 2.20 time: 0.076070 Aug 29 21:38:38.224808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 245/488] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:38 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:39.248088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:39.248662 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:39.255521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:39.256064 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:39.256464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:39.257179 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:39.257623 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:39.258043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:39.332085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:39.340573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:39.342572 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:39.343685 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-489078bf-c7a4-4dec-ba17-d95ecc1a23dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1334 microversion: 2.20 time: 0.100282 Aug 29 21:38:39.351818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 244/489] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:39 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:40.371986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:40.371986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:40.377866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:40.377996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:40.378410 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:40.379111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:40.379818 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:40.380402 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:40.600957 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:40.613143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:40.614972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:40.616117 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4638d7fa-5fdb-4ba3-81ac-297783a17d34 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1408 microversion: 2.20 time: 0.250671 Aug 29 21:38:40.616688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 246/490] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:40 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:40.874192 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-726bd1ce-4287-435a-815b-17911f4b7a43 req-dffd5f39-f168-4430-b295-35b038c23111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11491cff-58f2-4d90-ae11-471c65c47bcb", "tag": "d22eeab8-4235-4014-83a9-d0d8e059e752"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:40.887455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-726bd1ce-4287-435a-815b-17911f4b7a43 req-dffd5f39-f168-4430-b295-35b038c23111 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:40.887868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-726bd1ce-4287-435a-815b-17911f4b7a43 req-dffd5f39-f168-4430-b295-35b038c23111 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:40.888296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-726bd1ce-4287-435a-815b-17911f4b7a43 req-dffd5f39-f168-4430-b295-35b038c23111 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:40.903633 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-726bd1ce-4287-435a-815b-17911f4b7a43 req-dffd5f39-f168-4430-b295-35b038c23111 service nova] Creating event network-changed:d22eeab8-4235-4014-83a9-d0d8e059e752 for instance 11491cff-58f2-4d90-ae11-471c65c47bcb on hv-cinder-85426 Aug 29 21:38:40.908593 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-726bd1ce-4287-435a-815b-17911f4b7a43 req-dffd5f39-f168-4430-b295-35b038c23111 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038048 Aug 29 21:38:40.909207 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 245/491] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:41.639626 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:41.640497 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:41.646981 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:41.647457 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:41.647887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:41.648567 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:41.649035 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:41.649451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:41.786569 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:41.795194 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:41.796647 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:41.797747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6ec50096-9434-4ede-8d95-2c53f9ac3ee5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1408 microversion: 2.20 time: 0.162410 Aug 29 21:38:41.798297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 247/492] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:41 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:42.821284 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:42.821981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:42.830697 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:42.831505 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:42.831945 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:42.832730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:42.833412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:42.833854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:43.022936 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:43.031450 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:43.033002 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:43.034565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f3fd4c0b-2c42-4700-a50a-bedc22e1a726 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1408 microversion: 2.20 time: 0.217362 Aug 29 21:38:43.035352 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 246/493] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:42 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:44.059960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:44.060577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:44.067496 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:44.067983 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:44.068418 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:44.069225 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:44.069599 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:44.070028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:44.210018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:44.218659 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:44.220090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:44.221216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7b2f90d4-65ae-4936-b57b-cd812507c4f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1408 microversion: 2.20 time: 0.165741 Aug 29 21:38:44.221768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 248/494] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:44 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:45.244972 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:45.245521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:45.252240 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:45.252787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:45.253228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:45.253949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:45.254431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:45.254885 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:45.390866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:45.399324 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:45.401427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:45.402614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c4679f30-a279-4db9-8678-57113b53ce0e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1408 microversion: 2.20 time: 0.161793 Aug 29 21:38:45.403219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 247/495] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:45 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:46.036255 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-6fe758ec-46c2-4abf-90c3-60cac1f1d6eb req-eec32d21-ebc7-41a5-830d-4d8819ad1ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11491cff-58f2-4d90-ae11-471c65c47bcb", "name": "network-vif-plugged", "status": "completed", "tag": "d22eeab8-4235-4014-83a9-d0d8e059e752"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:46.046196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-6fe758ec-46c2-4abf-90c3-60cac1f1d6eb req-eec32d21-ebc7-41a5-830d-4d8819ad1ba2 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.046674 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-6fe758ec-46c2-4abf-90c3-60cac1f1d6eb req-eec32d21-ebc7-41a5-830d-4d8819ad1ba2 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.047230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-6fe758ec-46c2-4abf-90c3-60cac1f1d6eb req-eec32d21-ebc7-41a5-830d-4d8819ad1ba2 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.059272 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-6fe758ec-46c2-4abf-90c3-60cac1f1d6eb req-eec32d21-ebc7-41a5-830d-4d8819ad1ba2 service nova] Creating event network-vif-plugged:d22eeab8-4235-4014-83a9-d0d8e059e752 for instance 11491cff-58f2-4d90-ae11-471c65c47bcb on hv-cinder-85426 Aug 29 21:38:46.064720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-6fe758ec-46c2-4abf-90c3-60cac1f1d6eb req-eec32d21-ebc7-41a5-830d-4d8819ad1ba2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Aug 29 21:38:46.065337 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 249/496] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:46.425339 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:46.425948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:46.433870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.434535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.434920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.435673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.436139 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.436620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.577530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:46.586194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:46.587588 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:46.589215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e09a77c9-4716-4c0a-afbf-b59d3ee9c16e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1408 microversion: 2.20 time: 0.167825 Aug 29 21:38:46.589778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 248/497] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:46 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:47.470015 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:47.470599 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:47.476639 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.477115 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.477539 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.478219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.479362 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.479798 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.505747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cddbb298-6ed5-478d-8d7a-bcb144bf73fb tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/ips" status: 200 len: 150 microversion: 2.1 time: 0.040419 Aug 29 21:38:47.506327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 250/498] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:38:47 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:47.612419 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:47.613154 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:47.615150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:47.615804 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:47.622181 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.623599 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.623599 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.623854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.624240 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.624695 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.779181 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:47.789658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:47.791608 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:47.792818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7c274708-503b-4e30-ab27-cbf3071d2c65 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1408 microversion: 2.20 time: 0.184205 Aug 29 21:38:47.793579 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 249/499] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:47 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:48.815463 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:48.816064 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:48.818109 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:48.823641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:48.824130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:48.824559 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:48.825294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:48.825720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:48.826131 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:48.861892 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4882285e-c994-49ce-bb3a-7afe7b446c9c"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:48.864875 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:48.871128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:48.871712 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:48.872154 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:48.872873 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:48.873348 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:48.873753 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:48.985970 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:48.994569 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:48.996026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:48.997282 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-46e92ae6-532e-4b30-922d-c97f1303b9a6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1601 microversion: 2.20 time: 0.185704 Aug 29 21:38:48.998029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 251/500] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:48 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1601 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:49.026189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:49.026762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:49.033133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:49.033971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:49.034423 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:49.035235 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:49.035713 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:49.036169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:49.126676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f0b4a676-8a5c-4ee8-84c1-d8939e4fc95c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105019 Aug 29 21:38:49.127269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 252/501] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 21:38:49 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:38:49.176435 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b24a40a5-ab0b-4cfe-8bc8-fe3c270f3b36 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318220 Aug 29 21:38:49.183049 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 250/502] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:38:48 2022] POST /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:50.359682 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-a0a95e1a-b2a0-4fa8-bd61-3fbc7f9430ec req-ae680335-1b66-49d6-9d2f-7938cb998049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11491cff-58f2-4d90-ae11-471c65c47bcb", "tag": "d22eeab8-4235-4014-83a9-d0d8e059e752"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:50.369071 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a0a95e1a-b2a0-4fa8-bd61-3fbc7f9430ec req-ae680335-1b66-49d6-9d2f-7938cb998049 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:50.369544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a0a95e1a-b2a0-4fa8-bd61-3fbc7f9430ec req-ae680335-1b66-49d6-9d2f-7938cb998049 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:50.369970 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-a0a95e1a-b2a0-4fa8-bd61-3fbc7f9430ec req-ae680335-1b66-49d6-9d2f-7938cb998049 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:50.381404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-a0a95e1a-b2a0-4fa8-bd61-3fbc7f9430ec req-ae680335-1b66-49d6-9d2f-7938cb998049 service nova] Creating event network-changed:d22eeab8-4235-4014-83a9-d0d8e059e752 for instance 11491cff-58f2-4d90-ae11-471c65c47bcb on hv-cinder-85426 Aug 29 21:38:50.386185 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-a0a95e1a-b2a0-4fa8-bd61-3fbc7f9430ec req-ae680335-1b66-49d6-9d2f-7938cb998049 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030706 Aug 29 21:38:50.386783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 253/503] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:52.973922 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:52.974735 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:52.981192 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:52.981638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:52.982072 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:52.982755 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:52.983211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:52.983628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:53.064121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lazy-loading 'services' on Instance uuid 446cfebe-c164-4c5b-8312-67dd13da2898 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:53.138762 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b62fab05-4f58-4d07-b4f3-c91cdfdfb7d8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments/4b76469e-5342-40cb-b999-f13d2bbf6579" status: 202 len: 0 microversion: 2.1 time: 0.169476 Aug 29 21:38:53.139355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 251/504] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:38:52 2022] DELETE /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments/4b76469e-5342-40cb-b999-f13d2bbf6579 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:38:53.149791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:53.152815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:53.160726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:53.161097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:53.161731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:53.162435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:53.162887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:53.163307 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:53.194372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1d621c16-61f9-43de-9f90-a65369ddeb85 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049560 Aug 29 21:38:53.194926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 254/505] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:53 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:54.208680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:54.210878 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:54.217531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:54.218103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:54.218535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:54.219221 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:54.219670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:54.220338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:54.246361 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:54.252192 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1981b434-f31a-4b44-b00c-d3a3f98cc16c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048377 Aug 29 21:38:54.252809 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 252/506] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:54 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:55.266660 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:55.269529 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:55.277220 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.277737 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.278477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.279581 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.280052 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.280504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.317568 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f62a06ee-3d54-47e9-8059-9c4d069ca564 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056527 Aug 29 21:38:55.318338 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 255/507] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:55 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:55.352381 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:55.355102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:55.363720 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.364208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.364663 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.365365 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.365814 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.366231 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.397516 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2fc09ddd-2a97-44b8-9b87-f8337f947737 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049234 Aug 29 21:38:55.398076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 253/508] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:55 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:38:55.483335 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:55.484165 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:55.489754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.490244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.490680 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.491374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.491843 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.492269 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.517674 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:38:55.564524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:55.598324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4f3242b5-438e-4158-af0c-765547c7c7a3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 204 len: 0 microversion: 2.1 time: 0.118630 Aug 29 21:38:55.598922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 256/509] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:38:55 2022] DELETE /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:38:55.607554 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:55.608164 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:55.614033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.614498 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.614926 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.615621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:55.616071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:55.616489 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:55.747622 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:55.755501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-cea14148-c463-4b8a-93f4-0e776db002cd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1675 microversion: 2.1 time: 0.152205 Aug 29 21:38:55.756061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 254/510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:55 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:56.330554 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:56.332808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:56.339182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.339670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.340106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.341001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.341590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.341949 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.374277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-718b1b39-a3b8-487d-bd22-2e367b1ae8a3 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048054 Aug 29 21:38:56.374837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 257/511] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:56 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:56.777694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:56.778337 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:56.784952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.785441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.785877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.786563 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.787016 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.787439 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.926732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:56.934930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e2686aac-bfc0-4795-9b2e-d7bdd2bfa5c8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1675 microversion: 2.1 time: 0.161276 Aug 29 21:38:56.935491 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 255/512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:56 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:57.387372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:57.389600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:57.396423 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.396939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.397362 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.398074 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.398524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.398945 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.429430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-06be7fad-e4e4-4a02-8a3f-ba80a178db80 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046437 Aug 29 21:38:57.429992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 258/513] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:57 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:57.796421 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4882285e-c994-49ce-bb3a-7afe7b446c9c"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:57.799187 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:57.805901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.806913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.807355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.808054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.808637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.809089 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Invalid volume: volume 4882285e-c994-49ce-bb3a-7afe7b446c9c is already attached to instances: c3d22285-60c9-4602-aa73-9cfac08e8497 Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: POST /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments HTTP/1.1 Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 74 Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:38:57.895803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {"volumeAttachment": {"volumeId": "4882285e-c994-49ce-bb3a-7afe7b446c9c"}} Aug 29 21:38:57.897347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Invalid volume: volume 4882285e-c994-49ce-bb3a-7afe7b446c9c is already attached to instances: c3d22285-60c9-4602-aa73-9cfac08e8497 Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'server_id': 'c3d22285-60c9-4602-aa73-9cfac08e8497', 'body': {'volumeAttachment': {'volumeId': '4882285e-c994-49ce-bb3a-7afe7b446c9c'}}} Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4882285e-c994-49ce-bb3a-7afe7b446c9c is already attached to instances: c3d22285-60c9-4602-aa73-9cfac08e8497 Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:57.898108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4882285e-c994-49ce-bb3a-7afe7b446c9c is already attached to instances: c3d22285-60c9-4602-aa73-9cfac08e8497 Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:57.899412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4882285e-c994-49ce-bb3a-7afe7b446c9c is already attached to instances: c3d22285-60c9-4602-aa73-9cfac08e8497 Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 400 to user: Invalid volume: volume 4882285e-c994-49ce-bb3a-7afe7b446c9c is already attached to instances: c3d22285-60c9-4602-aa73-9cfac08e8497 {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8aa2566d-373b-4bce-8447-97ed048eede4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103134 Aug 29 21:38:57.901061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 256/514] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:38:57 2022] POST /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:38:57.955667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:57.956382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:57.964442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.965428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.966253 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.966721 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.967142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.968396 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:57.968916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:57.977269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.977939 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.978433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.979289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.979620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.980067 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.074600 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lazy-loading 'services' on Instance uuid c3d22285-60c9-4602-aa73-9cfac08e8497 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:58.161454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-336c5b0a-4e1e-4a64-ba0b-57dcb6851086 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments/4882285e-c994-49ce-bb3a-7afe7b446c9c" status: 202 len: 0 microversion: 2.1 time: 0.197176 Aug 29 21:38:58.162345 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 257/515] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:38:57 2022] DELETE /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments/4882285e-c994-49ce-bb3a-7afe7b446c9c => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:38:58.173364 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:58.175716 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:58.187013 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.187515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.188195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.189018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.189528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.190639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.213845 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:58.224622 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c515de69-f602-49eb-9ce7-4eb61d1e8a1d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1675 microversion: 2.1 time: 0.272765 Aug 29 21:38:58.225383 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 259/516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:57 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:58.249169 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a70c2ee4-5195-4d58-aadc-647b07b6064c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080292 Aug 29 21:38:58.253528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 258/517] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:58 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:58.442024 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:58.444191 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:58.446907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:58.452455 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.452978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.453413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.454125 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.454574 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.455017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.490811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1adbcf1e-2562-495a-aea1-f44f92e4fd45 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052846 Aug 29 21:38:58.491554 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 260/518] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:58 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:59.004775 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-dee0a515-907a-4675-9a86-e4f1b3096c07 req-b6c6d5ca-c997-4121-baed-08ba85f06a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3846b1-ac29-4006-89ea-bcd7a6c82b2d", "name": "network-vif-deleted", "tag": "b456e2d3-818e-4eae-971c-1b0f5b3baa83"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:59.011480 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:59.018342 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-dee0a515-907a-4675-9a86-e4f1b3096c07 req-b6c6d5ca-c997-4121-baed-08ba85f06a0f service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.018990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-dee0a515-907a-4675-9a86-e4f1b3096c07 req-b6c6d5ca-c997-4121-baed-08ba85f06a0f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.019224 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-dee0a515-907a-4675-9a86-e4f1b3096c07 req-b6c6d5ca-c997-4121-baed-08ba85f06a0f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.033393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-dee0a515-907a-4675-9a86-e4f1b3096c07 req-b6c6d5ca-c997-4121-baed-08ba85f06a0f service nova] Creating event network-vif-deleted:b456e2d3-818e-4eae-971c-1b0f5b3baa83 for instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d on hv-cinder-85426 Aug 29 21:38:59.041051 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-dee0a515-907a-4675-9a86-e4f1b3096c07 req-b6c6d5ca-c997-4121-baed-08ba85f06a0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039866 Aug 29 21:38:59.042429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 259/519] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:59.249110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.249824 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.256136 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.256768 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.257106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.258149 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.258695 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.259915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.266430 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.269010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.276236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.277137 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.277760 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.279016 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.279750 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.280378 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.300178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.300705 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.301362 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.301877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lazy-loading 'fault' on Instance uuid 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:59.319878 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e5cc8dc7-9e5e-4764-8aa6-6a828a9f9255 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061660 Aug 29 21:38:59.327100 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 260/520] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:59 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:38:59.386000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:59.392559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.393626 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.397530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b2854ac5-7819-4759-a829-f482ab7b6572 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1328 microversion: 2.1 time: 0.152379 Aug 29 21:38:59.398543 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 261/521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:59 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:59.402362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.402856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.403286 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.403978 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.404431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.404885 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.430682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:38:59.504967 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.507349 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.511515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2f90517e-0981-468e-8506-ce24a9c49e6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 204 len: 0 microversion: 2.1 time: 0.123886 Aug 29 21:38:59.512261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 261/522] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:38:59 2022] DELETE /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:38:59.516868 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.517656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.518231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.519196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.519658 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.520093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.522077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.522669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.529097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.529827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.530426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.531490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.532147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.532568 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.551837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-aef44dce-9ee2-4407-b240-ea7ad714b66a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052161 Aug 29 21:38:59.552450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 262/523] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:59 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:38:59.643429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.644020 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.650516 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.651364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.652011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.652956 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.653452 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.654081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.691948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:38:59.710852 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:59.722740 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d238cddd-e19a-4b02-a69d-2b4c7f86eca8 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1682 microversion: 2.1 time: 0.204751 Aug 29 21:38:59.724279 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 262/524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:59 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:59.783489 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-04de4eb8-7913-4094-b15d-e10962604742 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 204 len: 0 microversion: 2.1 time: 0.144022 Aug 29 21:38:59.784077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 263/525] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:38:59 2022] DELETE /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:38:59.792995 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.793717 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.799584 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.800064 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.800492 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.801234 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.801681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.802091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.941628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:59.949952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7aed9a42-c0a7-4fbb-8112-b4a7ce9b12f4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1689 microversion: 2.1 time: 0.161446 Aug 29 21:38:59.950562 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 263/526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:59 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:00.419762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:00.420447 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:00.426468 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.426945 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.427376 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.428061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.428509 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.430006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.462526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.463004 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.463585 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.464215 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lazy-loading 'fault' on Instance uuid 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:00.508504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:00.517072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-74933a11-8f51-416c-92c6-d0d2b8781c40 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 200 len: 1328 microversion: 2.1 time: 0.101950 Aug 29 21:39:00.517703 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 264/527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:00 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:00.746899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:00.747586 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:00.754792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.755356 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.755798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.756497 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.757017 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.757439 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.904099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:00.911996 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9d84d670-19c2-44ee-84c2-fe4d13913ad9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1682 microversion: 2.1 time: 0.169897 Aug 29 21:39:00.912575 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 264/528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:00 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:00.972025 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:00.972668 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:00.978643 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.979130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.979567 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:00.980258 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:00.980751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:00.981177 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.126582 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:01.134318 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c14ffb1f-0708-4898-be2f-819279c34dba tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1689 microversion: 2.1 time: 0.166172 Aug 29 21:39:01.134881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 265/529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:00 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:01.538490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:01.539122 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:01.545467 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.545956 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.546396 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.547089 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.547548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.547975 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.562076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] HTTP exception thrown: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Request method failure captured: Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d HTTP/1.1 Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDgJlt1hIdKWzVSNuJ7Z2XsO7-YQzlkvopv0cHPX_mcqhuj0CTbxSAOW5A-185DPw0KeQycyOLQjHzS9WKPsu5xkX7A5Zw82if5fc07n5xMrrRLv6s8dG5g_oQgqX0KXEPBJOlw6fOKGEysXIN8t5cdgdGNPwsBs6ZpplhKt43VBl4 Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:39:01.563739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d9928c37b2b46f5abd0ac1ba1c3ca92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 6f0d97b196f44ec985db30f86d4ad3f4 Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:39:01.565308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '4c3846b1-ac29-4006-89ea-bcd7a6c82b2d'} Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:01.566186 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:39:01.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:01.568983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Returning 404 to user: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:01.568983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-521dccf0-635c-4fa3-8904-f76b8e09a87b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 404 len: 111 microversion: 2.1 time: 0.030631 Aug 29 21:39:01.568983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 265/530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:01 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:01.574779 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-56528f00-4050-4df2-8cb0-fb4760097f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '.version_select at 0x7f5402baa700>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:01.593727 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-56528f00-4050-4df2-8cb0-fb4760097f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141003328" status: 202 len: 0 microversion: 2.1 time: 0.023257 Aug 29 21:39:01.594276 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 266/531] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 21:39:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141003328 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:01.933699 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:01.934307 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:01.940827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.941311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.941741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.942434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.942886 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.943307 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:02.156073 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:02.157056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:02.163482 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:02.163967 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:02.164675 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:02.166067 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:02.166717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:02.167503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:02.423061 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:02.426454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:02.430971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bf62e5e0-176a-47d9-8c77-9170800ee3e3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1682 microversion: 2.1 time: 0.501678 Aug 29 21:39:02.431590 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 266/532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:01 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1682 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:02.434167 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c57085e2-9b29-4b16-912c-6771c7350af7 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1689 microversion: 2.1 time: 0.281996 Aug 29 21:39:02.434916 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 267/533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:02 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:02.436340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-be25087f-ef22-4809-ba43-94ef92bceed9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'create', calling method: .version_select at 0x7f5402c5e3a0>, body: {"keypair": {"name": "tempest-keypair-105059503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtwf3fWt/xEUgSJCIP1OXEtVGax4J030t2bb1mKMsBhswfgFX7KUVV2VsRv+7uuO2zGfRCV2dLyn+iu6cco/2Rb2gUzG7re6tW+V0y833eDYvjIxHcdS9ATq5WI8Oulzg=="}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:02.452522 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-be25087f-ef22-4809-ba43-94ef92bceed9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:02.456398 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-be25087f-ef22-4809-ba43-94ef92bceed9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for user 6f0d97b196f44ec985db30f86d4ad3f4 and project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:02.480029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-be25087f-ef22-4809-ba43-94ef92bceed9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047426 Aug 29 21:39:02.480642 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 267/534] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:39:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:03.452314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:03.452958 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:03.455086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:03.455919 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:03.459488 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:03.459969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:03.460401 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:03.461139 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:03.461898 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:03.462909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:03.463152 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:03.463723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:03.464225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:03.465122 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:03.466448 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:03.466582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:03.737481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:03.745918 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4a63a819-06b4-4efd-875a-e1225e2f19d6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1689 microversion: 2.1 time: 0.295580 Aug 29 21:39:03.746728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 268/535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:03 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1689 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:03.761203 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:03.769511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0ce9d3f3-1265-4a5f-a8a4-4ce875395d6c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1682 microversion: 2.1 time: 0.321487 Aug 29 21:39:03.770187 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 268/536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:03 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1682 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:03.923540 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1964241406", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "514f3495-f14d-42c1-bc82-a600d1b5d3d8"}], "security_groups": [{"name": "tempest-securitygroup--2035647952"}], "key_name": "tempest-keypair-105059503", "user_data": "}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:04.027245 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] validate_networks() for [('514f3495-f14d-42c1-bc82-a600d1b5d3d8', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:39:04.509689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:39:04.510309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:39:04.510778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:39:04.511277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:39:04.511689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:39:04.521943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.522429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.522866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.523597 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.524057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.524488 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.543058 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:04.547669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Getting quotas for user 6f0d97b196f44ec985db30f86d4ad3f4 and project 7d9928c37b2b46f5abd0ac1ba1c3ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:04.559251 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:39:04.561602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:39:04.614005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9fe4d78c-8077-4561-bc12-6b3a06ddb28d tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.694597 Aug 29 21:39:04.614833 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 269/537] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:39:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:39:04.626060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3f3e2e42-abc9-4f01-9ec9-82ad661c3f15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:04.626724 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3f3e2e42-abc9-4f01-9ec9-82ad661c3f15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:04.771778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:04.772940 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:04.789943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.791510 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.792229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.794558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.795400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.795833 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.805940 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:04.897164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3f3e2e42-abc9-4f01-9ec9-82ad661c3f15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:04.907160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3f3e2e42-abc9-4f01-9ec9-82ad661c3f15 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1237 microversion: 2.1 time: 0.284830 Aug 29 21:39:04.907672 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 269/538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:04 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1237 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:04.920473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:04.920473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:04.920473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.920473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.921183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.922062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.922656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.923310 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:05.533634 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:05.543730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6650bec6-de2f-448e-940f-264bebd390c6 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1689 microversion: 2.1 time: 0.779632 Aug 29 21:39:05.546335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 270/539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:04 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1689 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:05.614260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:05.625112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-87038c67-28bf-4433-9854-90d6bd958e37 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1682 microversion: 2.1 time: 0.716301 Aug 29 21:39:05.625757 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 270/540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:04 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1682 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:05.927882 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:05.928826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:05.936268 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:05.937180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:05.937846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:05.938613 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:05.939134 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:05.939915 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.065546 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:06.073063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-963c10e9-c25a-4720-b9b6-e333e08197c0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1307 microversion: 2.1 time: 0.149421 Aug 29 21:39:06.073618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 271/541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:05 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:06.566869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:06.567654 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:06.574591 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.575156 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.575591 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.576288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.576773 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.577193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.649146 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:06.650994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:06.657640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.658363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.658971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.659830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.660456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.661038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.708868 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:06.722492 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-79b9b8c7-03c8-425f-b99c-0e3a864502f8 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1621 microversion: 2.1 time: 0.159067 Aug 29 21:39:06.731880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 271/542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:06 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1621 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:06.739337 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-f1022c31-42e9-47e9-897e-a47c73118b27 req-ff4aa679-1ae9-4d8d-9bfb-558772d1c7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446cfebe-c164-4c5b-8312-67dd13da2898", "name": "network-vif-deleted", "tag": "d6330450-f0d1-4063-9b9d-1477fa88871b"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:06.756263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1022c31-42e9-47e9-897e-a47c73118b27 req-ff4aa679-1ae9-4d8d-9bfb-558772d1c7d1 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.756558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1022c31-42e9-47e9-897e-a47c73118b27 req-ff4aa679-1ae9-4d8d-9bfb-558772d1c7d1 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.762687 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f1022c31-42e9-47e9-897e-a47c73118b27 req-ff4aa679-1ae9-4d8d-9bfb-558772d1c7d1 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.770959 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:06.780365 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d3300627-8dcb-4a40-a7ed-3271995e6525 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1614 microversion: 2.1 time: 0.134968 Aug 29 21:39:06.781310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 272/543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:06 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1614 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:06.788794 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-f1022c31-42e9-47e9-897e-a47c73118b27 req-ff4aa679-1ae9-4d8d-9bfb-558772d1c7d1 service nova] Creating event network-vif-deleted:d6330450-f0d1-4063-9b9d-1477fa88871b for instance 446cfebe-c164-4c5b-8312-67dd13da2898 on hv-cinder-85426 Aug 29 21:39:06.804690 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-f1022c31-42e9-47e9-897e-a47c73118b27 req-ff4aa679-1ae9-4d8d-9bfb-558772d1c7d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066644 Aug 29 21:39:06.806069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 272/544] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:07.094935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:07.095690 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:07.107780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.108281 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.108788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.114950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.117815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.119182 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.270888 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:07.289031 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6b6cd8a1-14c8-4a3c-af1d-18b232d3f5d1 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1295 microversion: 2.1 time: 0.198007 Aug 29 21:39:07.306780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 273/545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:07 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1295 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:07.750579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:07.751289 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:07.758422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.759699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.760340 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.761106 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.761569 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.762268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.784149 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:07.803325 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.804200 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.804868 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.805476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:07.806868 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lazy-loading 'fault' on Instance uuid 446cfebe-c164-4c5b-8312-67dd13da2898 {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:07.807183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:07.819382 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.820285 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.820963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.822867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.823506 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.824083 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.881125 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.881668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.882247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.882893 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lazy-loading 'fault' on Instance uuid c3d22285-60c9-4602-aa73-9cfac08e8497 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:07.903815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:07.916473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-fe7af0b1-ffae-4c2e-8021-7ed501ad8c9a tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 200 len: 1334 microversion: 2.1 time: 0.170452 Aug 29 21:39:07.919895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 273/546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:07 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 1334 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:07.962216 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:07.973504 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-eaddfa2c-d777-4b50-a8fa-88cfb254ab87 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 200 len: 1331 microversion: 2.1 time: 0.172669 Aug 29 21:39:07.974980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 274/547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:07 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 1331 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:08.314268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:08.315063 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:08.323281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:08.323883 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:08.324453 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:08.325297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:08.325864 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:08.326482 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:08.615478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:08.625320 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-af8eddf0-2814-44a4-abdd-d2e68c5432e9 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1363 microversion: 2.1 time: 0.315848 Aug 29 21:39:08.625912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 274/548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:08 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:08.825883 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-be4bdd65-b551-43b7-b3df-aa9918c21981 req-260a466f-d859-4c02-9ce1-7beb8d1be851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d22285-60c9-4602-aa73-9cfac08e8497", "name": "network-vif-deleted", "tag": "66d1d8cf-a6b7-4912-a40d-0d03daba0a3c"}, {"name": "network-changed", "server_uuid": "7171d45d-5cb8-4d4f-977b-ee2671c5f571", "tag": "aa8ad2bc-9646-412b-97d9-d20f139892e1"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:08.836433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-be4bdd65-b551-43b7-b3df-aa9918c21981 req-260a466f-d859-4c02-9ce1-7beb8d1be851 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:08.836931 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-be4bdd65-b551-43b7-b3df-aa9918c21981 req-260a466f-d859-4c02-9ce1-7beb8d1be851 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:08.838032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-be4bdd65-b551-43b7-b3df-aa9918c21981 req-260a466f-d859-4c02-9ce1-7beb8d1be851 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:08.850174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-be4bdd65-b551-43b7-b3df-aa9918c21981 req-260a466f-d859-4c02-9ce1-7beb8d1be851 service nova] Creating event network-vif-deleted:66d1d8cf-a6b7-4912-a40d-0d03daba0a3c for instance c3d22285-60c9-4602-aa73-9cfac08e8497 on hv-cinder-85426 Aug 29 21:39:08.850674 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-be4bdd65-b551-43b7-b3df-aa9918c21981 req-260a466f-d859-4c02-9ce1-7beb8d1be851 service nova] Creating event network-changed:aa8ad2bc-9646-412b-97d9-d20f139892e1 for instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 on hv-cinder-85426 Aug 29 21:39:08.857106 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-be4bdd65-b551-43b7-b3df-aa9918c21981 req-260a466f-d859-4c02-9ce1-7beb8d1be851 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035317 Aug 29 21:39:08.857713 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 275/549] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:08.939493 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:08.940104 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 446cfebe-c164-4c5b-8312-67dd13da2898] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:08.947334 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:08.947834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:08.948273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:08.948997 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:08.949458 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:08.949878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:08.963343 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] HTTP exception thrown: Instance 446cfebe-c164-4c5b-8312-67dd13da2898 could not be found. Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Request method failure captured: Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 HTTP/1.1 Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZcJayaPMiVvOdb4QlD1aS9Nlrx6Ud6omWvPEIlFcBGr68ocnfX4OqlkiAD4SgTPp40rgWrvvVdXEKuKJV0IyMWnMNUyRa67hjywKRHUH9PKNHVT8hJ4qmm9XZYQ-vQMdzneL75fqS0xSfG_h0RCKaRx3ndFEnNDSuqeAe22J-D5c Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:39:08.964996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57c7abc43eb142d3b36a6d91beee5d10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 5344cf7b391d44beac2c602ac3e2e64b Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 446cfebe-c164-4c5b-8312-67dd13da2898 could not be found. Aug 29 21:39:08.966481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '446cfebe-c164-4c5b-8312-67dd13da2898'} Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446cfebe-c164-4c5b-8312-67dd13da2898 could not be found. Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:08.967388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446cfebe-c164-4c5b-8312-67dd13da2898 could not be found. Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446cfebe-c164-4c5b-8312-67dd13da2898 could not be found. Aug 29 21:39:08.968954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:08.970359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Returning 404 to user: Instance 446cfebe-c164-4c5b-8312-67dd13da2898 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:08.970359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8d241c6b-c509-4b80-9641-cfe69e813ab4 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898" status: 404 len: 111 microversion: 2.1 time: 0.030903 Aug 29 21:39:08.970359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 275/550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:08 2022] GET /compute/v2.1/servers/446cfebe-c164-4c5b-8312-67dd13da2898 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:08.975864 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f1d5991d-be82-4a38-b0ed-4bfe56be7b57 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '.version_select at 0x7f5402c5e3a0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:08.996236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f1d5991d-be82-4a38-b0ed-4bfe56be7b57 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379636365" status: 202 len: 0 microversion: 2.1 time: 0.024411 Aug 29 21:39:08.996807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:08.997874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:09.000395 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 276/551] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 21:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379636365 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:09.004341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:09.004978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:09.005527 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:09.006332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:09.007038 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:09.007537 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:09.022389 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 HTTP/1.1 Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:39:09.024273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:39:09.025880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'c3d22285-60c9-4602-aa73-9cfac08e8497'} Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:09.026785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:39:09.028503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:09.033428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:09.033428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-07fcbbd4-7ab2-4f2f-b1f0-528efce60381 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 404 len: 111 microversion: 2.1 time: 0.035182 Aug 29 21:39:09.033428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 276/552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:08 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:39:09.041351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5bdf7204-fe95-48db-bf3e-ccc87c2de39d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '.version_select at 0x7f5402b3a8b0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:09.067940 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5bdf7204-fe95-48db-bf3e-ccc87c2de39d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517502363" status: 202 len: 0 microversion: 2.1 time: 0.031164 Aug 29 21:39:09.073327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 277/553] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 21:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517502363 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:09.645576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:09.646178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:09.652792 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:09.653547 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:09.654931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:09.655870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:09.656546 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:09.657459 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:09.917558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:09.925430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ccf9fb5c-919b-4fc9-b46e-79650888a665 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1363 microversion: 2.1 time: 0.283390 Aug 29 21:39:09.925814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 277/554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:09 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:09.948814 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4d270678-2f22-4c24-825d-7153634ff0e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: .version_select at 0x7f5402aa1c10>, body: {"keypair": {"name": "tempest-keypair-2066723818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ9pVmFkEYsXmb/yq93bGNSXC2oHOC0/D2i5xwS27FoSZtkRbqU+oI/X1KqiZLpXxafX6aHO+QEqbG9p6aGoPJfy+PyzELT5ejO8joCZTVyem0bAK+y7g9JSRUMI6Lxiw=="}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:09.964994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4d270678-2f22-4c24-825d-7153634ff0e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:09.969287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4d270678-2f22-4c24-825d-7153634ff0e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'key_pairs'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:09.991207 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4d270678-2f22-4c24-825d-7153634ff0e1 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046808 Aug 29 21:39:09.991855 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 278/555] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:39:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:10.948696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:10.949391 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:10.959897 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:10.961386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:10.962721 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:10.963662 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:10.964300 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:10.964949 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.125088 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:11.133282 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-37d95a6f-478a-4808-9c60-07e81d5b153e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1363 microversion: 2.1 time: 0.189896 Aug 29 21:39:11.133853 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 278/556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:10 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:11.439049 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-344485758", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5edf4d12-91b6-4448-8d9a-6fbab4fee15a"}], "security_groups": [{"name": "tempest-securitygroup--956396433"}], "key_name": "tempest-keypair-2066723818", "user_data": "}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:11.509119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:11.509649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:11.516315 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.516832 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.517280 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.517978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.518434 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.518860 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.544654 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:11.546224 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] validate_networks() for [('5edf4d12-91b6-4448-8d9a-6fbab4fee15a', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:39:11.625922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a1a472d3-3bfd-494d-b383-8b79e25013a6 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 204 len: 0 microversion: 2.1 time: 0.120293 Aug 29 21:39:11.626738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 279/557] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:11 2022] DELETE /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:39:11.636154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:11.636879 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:11.643594 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.645021 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.645403 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.646114 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.646603 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.647032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.872729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:11.880456 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-640a20a4-e56f-48dc-bc93-36afbc35fbee tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1576 microversion: 2.1 time: 0.248985 Aug 29 21:39:11.880986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 280/558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:11 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:12.002418 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:39:12.002916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:39:12.003391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:39:12.003810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:39:12.004224 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:39:12.013934 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.014416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.015103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.015829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.016290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.016789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.034582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:12.040286 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Getting quotas for user 89b272427c6444b49293e5046c686ffc and project 5220f1dfa6a74754bd08f925c85847b2. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:12.049959 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:12.052789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:39:12.055437 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:39:12.065310 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:12.065942 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:12.076438 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.077169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.077700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.078507 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.079090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.079606 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.108760 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:12.112038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-49084834-cb59-42c5-a887-3ad8e09ecc28 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.677870 Aug 29 21:39:12.118847 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 279/559] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:39:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:39:12.124465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-21b6da02-f93c-4db7-941a-c022365460de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:12.126712 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-21b6da02-f93c-4db7-941a-c022365460de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:12.207094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-21b6da02-f93c-4db7-941a-c022365460de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:12.217179 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-21b6da02-f93c-4db7-941a-c022365460de tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1241 microversion: 2.1 time: 0.096775 Aug 29 21:39:12.218214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 280/560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:12 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:12.222988 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:12.223577 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:12.223939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a3737896-bb21-434c-bf73-a7b6c9922601 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 204 len: 0 microversion: 2.1 time: 0.161329 Aug 29 21:39:12.225014 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 281/561] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:12 2022] DELETE /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:39:12.231483 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.231996 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.232442 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.233853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.233853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.234060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.234143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:12.234794 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:12.241526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.242023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.242634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.244032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.244437 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.245208 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.458619 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:12.467992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:12.472523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4934e057-b3a5-469c-b97a-72be15c468ef tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1363 microversion: 2.1 time: 0.253111 Aug 29 21:39:12.476861 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 281/562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:12 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:12.479806 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5131a97e-76e6-48c5-add0-ea3f297568bf tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1506 microversion: 2.1 time: 0.250421 Aug 29 21:39:12.480501 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 282/563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:12 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:12.902549 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:12.903176 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:12.909355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.909836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.910316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.911032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.911481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.911899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.043969 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.051633 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f96d8dab-f06b-481a-bed9-22352534e3b5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1576 microversion: 2.1 time: 0.152936 Aug 29 21:39:13.052184 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 282/564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:12 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:13.238458 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:13.239005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:13.246100 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.246632 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.247807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.248765 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.249539 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.249762 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.317133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.324854 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f01c95d8-3396-4336-8bb7-62974a7308d6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1245 microversion: 2.1 time: 0.090192 Aug 29 21:39:13.325307 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 283/565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:13 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:13.499549 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:13.500089 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:13.500183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:13.500857 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:13.506707 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.506886 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.507199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.507401 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.507638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.507844 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.508328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.508616 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.509017 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.509136 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.509446 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.509541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.707954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.710864 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.715682 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-68e53ea4-fb4d-4f27-82c4-811bf0a2fada tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1506 microversion: 2.1 time: 0.219271 Aug 29 21:39:13.716639 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 284/566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:13 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:13.718668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bb2d423e-febe-4172-9482-6628d656bcd0 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1363 microversion: 2.1 time: 0.222968 Aug 29 21:39:13.719229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 283/567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:13 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:14.073718 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:14.074354 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:14.080535 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.081214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.081659 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.082411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.082913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.083361 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.149080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-7dd646f6-4792-45df-b2dd-8e18d030dcd7 req-97bf1a39-b3c2-48c7-b4eb-3d07007f1ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7171d45d-5cb8-4d4f-977b-ee2671c5f571", "name": "network-vif-plugged", "status": "completed", "tag": "aa8ad2bc-9646-412b-97d9-d20f139892e1"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:14.163815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-7dd646f6-4792-45df-b2dd-8e18d030dcd7 req-97bf1a39-b3c2-48c7-b4eb-3d07007f1ecd service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.164319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-7dd646f6-4792-45df-b2dd-8e18d030dcd7 req-97bf1a39-b3c2-48c7-b4eb-3d07007f1ecd service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.164787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-7dd646f6-4792-45df-b2dd-8e18d030dcd7 req-97bf1a39-b3c2-48c7-b4eb-3d07007f1ecd service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.176805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-7dd646f6-4792-45df-b2dd-8e18d030dcd7 req-97bf1a39-b3c2-48c7-b4eb-3d07007f1ecd service nova] Creating event network-vif-plugged:aa8ad2bc-9646-412b-97d9-d20f139892e1 for instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 on hv-cinder-85426 Aug 29 21:39:14.185377 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-7dd646f6-4792-45df-b2dd-8e18d030dcd7 req-97bf1a39-b3c2-48c7-b4eb-3d07007f1ecd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040406 Aug 29 21:39:14.186258 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 284/568] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:14.241496 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:14.250565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-90c1e38b-1e36-49a4-ac28-6b518491cfdf tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1576 microversion: 2.1 time: 0.180954 Aug 29 21:39:14.251141 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 285/569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:14 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:14.345537 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:14.346225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:14.352323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.352840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.353270 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.353949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.354400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.354818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.416710 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:14.424429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2d240749-f426-4859-980c-1886d071ce8a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1245 microversion: 2.1 time: 0.083061 Aug 29 21:39:14.425016 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 285/570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:14 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:14.736797 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:14.737328 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:14.737769 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:14.738387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:14.743327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.744420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.745097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.745976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.746127 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.746277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.746745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.746880 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.747258 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.748028 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.748490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.748945 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.906309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:14.951010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:14.954180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:14.958988 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1f0dbb50-fc8d-46bd-8d92-11fd48273a30 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1506 microversion: 2.1 time: 0.226227 Aug 29 21:39:14.959758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 286/571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:14 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:14.965076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5e272c55-15bc-42d7-9469-9f614c287ba3 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1363 microversion: 2.1 time: 0.231047 Aug 29 21:39:14.965717 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 286/572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:14 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:15.272189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:15.272972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:15.283130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.283130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.283130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.283944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.285025 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.285779 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.446194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:15.447840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:15.453989 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.454845 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.455259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.456190 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.456832 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.457658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.621291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:15.629052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a5af59c5-b484-4cb5-bdab-b71744b7bcab tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1293 microversion: 2.1 time: 0.186640 Aug 29 21:39:15.629713 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 287/573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:15 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1293 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:15.747638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:15.751122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:15.756495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ddfcf97f-d030-43b6-8f91-c51cd51029b1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1576 microversion: 2.1 time: 0.488240 Aug 29 21:39:15.757288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 287/574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:15 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1576 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:15.979916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:15.979916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:15.987911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:15.988167 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.988841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.989357 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.989870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:15.990158 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.990611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.991032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.001180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.001953 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.002558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.003425 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.004339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.005032 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.732107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:16.742298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:16.744369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6a2a12aa-b39d-4fc2-be04-6f1210184d2e tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1506 microversion: 2.1 time: 0.767678 Aug 29 21:39:16.745533 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 288/575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:15 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:16.751754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:16.753172 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:16.763199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.764655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.767128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.768913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.769356 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8351887f-d457-41b0-9c5d-cec00059cb7b tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1363 microversion: 2.1 time: 0.785840 Aug 29 21:39:16.769734 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.770364 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.782059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 288/576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:15 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1363 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:16.793379 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:16.795206 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:16.803124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.803717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.804361 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.805289 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.805874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.806952 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.884697 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:16.897133 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b5476367-0ec8-47b6-b142-817501e4708a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1299 microversion: 2.1 time: 0.150301 Aug 29 21:39:16.897799 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 289/577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:16 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:16.902422 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-2bc7fd18-93c2-4335-8b50-e3a467510e9f req-f2b46014-e4b8-48ff-8982-f0581e01f13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ad160e-81c4-4824-8a34-435c95763317", "name": "network-vif-deleted", "tag": "58008d54-7073-4d9c-b3a0-446d9eb287e2"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:16.912962 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-2bc7fd18-93c2-4335-8b50-e3a467510e9f req-f2b46014-e4b8-48ff-8982-f0581e01f13c service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.913533 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-2bc7fd18-93c2-4335-8b50-e3a467510e9f req-f2b46014-e4b8-48ff-8982-f0581e01f13c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.913996 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-2bc7fd18-93c2-4335-8b50-e3a467510e9f req-f2b46014-e4b8-48ff-8982-f0581e01f13c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.927318 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-2bc7fd18-93c2-4335-8b50-e3a467510e9f req-f2b46014-e4b8-48ff-8982-f0581e01f13c service nova] Creating event network-vif-deleted:58008d54-7073-4d9c-b3a0-446d9eb287e2 for instance 90ad160e-81c4-4824-8a34-435c95763317 on hv-cinder-85426 Aug 29 21:39:16.932824 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-2bc7fd18-93c2-4335-8b50-e3a467510e9f req-f2b46014-e4b8-48ff-8982-f0581e01f13c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033752 Aug 29 21:39:16.933421 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 290/578] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:17.054985 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:17.064877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3b3f1d63-04c2-445a-a357-95c84f49dd4e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1576 microversion: 2.1 time: 0.281737 Aug 29 21:39:17.065605 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 289/579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:16 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:17.778588 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:17.781113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:17.789602 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.790972 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.791857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.792882 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.793846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.794624 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.795089 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:17.795697 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:17.802373 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.802856 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.803284 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.803978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.804433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.804880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.840818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.841750 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.842417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.843325 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lazy-loading 'fault' on Instance uuid 90ad160e-81c4-4824-8a34-435c95763317 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:17.923693 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:17.939689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b55788eb-5678-4e2b-a449-e59489d84236 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 200 len: 1311 microversion: 2.1 time: 0.171956 Aug 29 21:39:17.940896 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 291/580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:17 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 1311 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:17.950914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:17.952020 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:17.959466 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.960175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.960751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.961630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.962954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.963908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.072015 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:18.086909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8b8172f9-6f72-406c-b284-eab7363c2e56 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1549 microversion: 2.1 time: 0.296248 Aug 29 21:39:18.106722 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 290/581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:17 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:18.118745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:18.119797 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:18.130213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.131190 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.131688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.132394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.132962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.133440 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.233854 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.235452 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.236262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.237181 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lazy-loading 'fault' on Instance uuid 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:18.333056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:18.345900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cb0997cd-9edc-4a70-9ef0-a92321803aad tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 200 len: 1230 microversion: 2.1 time: 0.236803 Aug 29 21:39:18.347208 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 291/582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:18 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 1230 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:18.354813 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:18.355508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:18.362152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.362636 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.363202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.364071 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.364776 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.365338 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.401382 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:18.409155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=100 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:18.413839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4c9d83e0-68f8-4643-9c78-ff826057c434 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.471091 Aug 29 21:39:18.414673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 292/583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:17 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:18.490533 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3effa737-5496-4acf-b2e3-2cd1b3afbf64 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141499 Aug 29 21:39:18.491334 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 292/584] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:39:18 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:18.952932 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-b5d30cf9-4737-4599-b4d8-f956d1c33e58 req-9b7b6a18-71ac-46bb-84c7-a13e9b9d8503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8", "name": "network-vif-deleted", "tag": "4035fd51-d29f-4d8c-bd5d-5ceb956be184"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:18.967156 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-b5d30cf9-4737-4599-b4d8-f956d1c33e58 req-9b7b6a18-71ac-46bb-84c7-a13e9b9d8503 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.967826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-b5d30cf9-4737-4599-b4d8-f956d1c33e58 req-9b7b6a18-71ac-46bb-84c7-a13e9b9d8503 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.968702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-b5d30cf9-4737-4599-b4d8-f956d1c33e58 req-9b7b6a18-71ac-46bb-84c7-a13e9b9d8503 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.973962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:18.974837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 90ad160e-81c4-4824-8a34-435c95763317] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:18.983701 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-b5d30cf9-4737-4599-b4d8-f956d1c33e58 req-9b7b6a18-71ac-46bb-84c7-a13e9b9d8503 service nova] Creating event network-vif-deleted:4035fd51-d29f-4d8c-bd5d-5ceb956be184 for instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 on hv-cinder-85426 Aug 29 21:39:18.984617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.985497 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.986455 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.987772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.988468 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.989333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.996353 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-b5d30cf9-4737-4599-b4d8-f956d1c33e58 req-9b7b6a18-71ac-46bb-84c7-a13e9b9d8503 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046592 Aug 29 21:39:18.999403 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 293/585] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:19.009139 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] HTTP exception thrown: Instance 90ad160e-81c4-4824-8a34-435c95763317 could not be found. Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Request method failure captured: Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 HTTP/1.1 Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZcJayaPMiVvOdb4QlD1aS9Nlrx6Ud6omWvPEIlFcBGr68ocnfX4OqlkiAD4SgTPp40rgWrvvVdXEKuKJV0IyMWnMNUyRa67hjywKRHUH9PKNHVT8hJ4qmm9XZYQ-vQMdzneL75fqS0xSfG_h0RCKaRx3ndFEnNDSuqeAe22J-D5c Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:39:19.011670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57c7abc43eb142d3b36a6d91beee5d10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 5344cf7b391d44beac2c602ac3e2e64b Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 90ad160e-81c4-4824-8a34-435c95763317 could not be found. Aug 29 21:39:19.013754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '90ad160e-81c4-4824-8a34-435c95763317'} Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ad160e-81c4-4824-8a34-435c95763317 could not be found. Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:19.014736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ad160e-81c4-4824-8a34-435c95763317 could not be found. Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ad160e-81c4-4824-8a34-435c95763317 could not be found. Aug 29 21:39:19.015907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.017168 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Returning 404 to user: Instance 90ad160e-81c4-4824-8a34-435c95763317 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:19.017168 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cbe486f2-2397-464c-89f5-79bfe5bd9142 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317" status: 404 len: 111 microversion: 2.1 time: 0.055570 Aug 29 21:39:19.017168 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 293/586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:18 2022] GET /compute/v2.1/servers/90ad160e-81c4-4824-8a34-435c95763317 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:19.095038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:19.095916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:19.104723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.105541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.106261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.108282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.108946 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.110200 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.157184 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:19.257436 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d5fd604e-2424-4e23-ade1-6047b65f154c tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 204 len: 0 microversion: 2.1 time: 0.237070 Aug 29 21:39:19.258528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 294/587] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:19 2022] DELETE /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:19.267338 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:19.268026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:19.273995 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.274549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.275082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.275838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.276470 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.277025 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.379183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:19.379947 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:19.394418 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.394938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.395400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.396143 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.396671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.397127 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.412868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] HTTP exception thrown: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Request method failure captured: Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 HTTP/1.1 Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTEuu3Pr_VzTsNG6hX3iKJqud0iKEa6TThjtjf3dvah6wO7fKjvOTKDYSSMC2ln2rZNMuVFnW0wzNg-fbu4eZtJlwSnmmbMZoIjGsbXSsiNwSdIOuQOd1YmQ8dLyd7I0IlBQYbBzusLQsxPcJQXUnB4X-qvlGRIW4w98h5AgZTSzZm0 Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:39:19.414603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98d4703c6737454291724a5ad15c9cbb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: d882c87d5de7497b822ec7b1798d2008 Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:39:19.416758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8'} Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:19.417639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:39:19.419225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:19.420501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Returning 404 to user: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:19.420501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c50d64ed-5c4a-4911-88ed-e73e09b10260 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 404 len: 111 microversion: 2.1 time: 0.042557 Aug 29 21:39:19.420690 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:19.426363 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dc6f7748-07a9-460b-9efb-f743e83c3441 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.163583 Aug 29 21:39:19.432209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 294/588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:19 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:19.432805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 295/589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:19 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:19.437499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:19.438287 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:19.441455 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:19.447312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.447824 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.448423 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.448991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.449456 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.450147 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.530321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1391743934", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-796113926", "security_groups": [{"name": "tempest-secgroup-smoke-365737483"}], "block_device_mapping_v2": [{"uuid": "a45b43a2-bd6f-4193-b745-942db89f81fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5e837a9d-67f3-4836-bdab-0e762646c779"}]}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:19.591729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:19.599283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-57fd6ebb-7066-46ee-84c8-f1ddeca40e81 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.165626 Aug 29 21:39:19.599912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 295/590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:19 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:19.654399 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] validate_networks() for [('5e837a9d-67f3-4836-bdab-0e762646c779', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:39:19.743277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-bb092636-3034-4e51-943a-4410140c26c9 req-29746883-7734-462e-9c5f-370937133583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7171d45d-5cb8-4d4f-977b-ee2671c5f571", "tag": "aa8ad2bc-9646-412b-97d9-d20f139892e1"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:19.753260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-bb092636-3034-4e51-943a-4410140c26c9 req-29746883-7734-462e-9c5f-370937133583 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:19.753737 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-bb092636-3034-4e51-943a-4410140c26c9 req-29746883-7734-462e-9c5f-370937133583 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:19.754325 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-bb092636-3034-4e51-943a-4410140c26c9 req-29746883-7734-462e-9c5f-370937133583 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:19.768654 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-bb092636-3034-4e51-943a-4410140c26c9 req-29746883-7734-462e-9c5f-370937133583 service nova] Creating event network-changed:aa8ad2bc-9646-412b-97d9-d20f139892e1 for instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 on hv-cinder-85426 Aug 29 21:39:19.773777 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-bb092636-3034-4e51-943a-4410140c26c9 req-29746883-7734-462e-9c5f-370937133583 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034096 Aug 29 21:39:19.775796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 296/591] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:20.041876 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:39:20.042374 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:39:20.042756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:39:20.043508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:39:20.043639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:39:20.052573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.053080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.053518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.054422 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.054847 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.055275 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.072402 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for project 98d4703c6737454291724a5ad15c9cbb. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:20.080562 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for user d882c87d5de7497b822ec7b1798d2008 and project 98d4703c6737454291724a5ad15c9cbb. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:20.139872 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:39:20.142085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a45b43a2-bd6f-4193-b745-942db89f81fc',volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:39:20.272936 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1e3eef78-2720-495f-879a-fabd014c1640 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748160 Aug 29 21:39:20.273744 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 296/592] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:39:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:39:20.286311 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c3124fad-fbbe-4cd1-9af8-ca6f2726bc6c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:20.287003 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c3124fad-fbbe-4cd1-9af8-ca6f2726bc6c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:20.348314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c3124fad-fbbe-4cd1-9af8-ca6f2726bc6c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:20.356791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c3124fad-fbbe-4cd1-9af8-ca6f2726bc6c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1094 microversion: 2.1 time: 0.074929 Aug 29 21:39:20.367732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 297/593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:20 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:20.448305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:20.449031 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:20.455591 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.456182 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.456729 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.457504 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.458043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.458543 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.608218 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:20.621036 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8f3e36bd-eb8f-4f2f-9bb5-4848c290e938 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.176975 Aug 29 21:39:20.621348 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:20.622350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:20.628063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 297/594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:20 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:20.647241 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.647740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.648172 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.648910 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.649534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.649998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.795077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:20.802737 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a459524a-4202-4d1c-a891-8e31fce39307 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.186075 Aug 29 21:39:20.803309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 298/595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:20 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:21.018114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-823080ad-4c92-4981-ad1a-fc696991f14e req-b4755a0f-a295-4485-a1fc-2a4a34cbbda3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cf2d9d-c660-4fb2-a97d-b14d667481ad", "tag": "b0874f96-e644-4660-bee2-6988edf50b89"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:21.027841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-823080ad-4c92-4981-ad1a-fc696991f14e req-b4755a0f-a295-4485-a1fc-2a4a34cbbda3 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.028327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-823080ad-4c92-4981-ad1a-fc696991f14e req-b4755a0f-a295-4485-a1fc-2a4a34cbbda3 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.028763 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-823080ad-4c92-4981-ad1a-fc696991f14e req-b4755a0f-a295-4485-a1fc-2a4a34cbbda3 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.039094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-823080ad-4c92-4981-ad1a-fc696991f14e req-b4755a0f-a295-4485-a1fc-2a4a34cbbda3 service nova] Creating event network-changed:b0874f96-e644-4660-bee2-6988edf50b89 for instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad on hv-cinder-85426 Aug 29 21:39:21.044106 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-823080ad-4c92-4981-ad1a-fc696991f14e req-b4755a0f-a295-4485-a1fc-2a4a34cbbda3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029949 Aug 29 21:39:21.044737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 298/596] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:21.377933 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:21.378579 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:21.385045 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.385533 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.385970 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.386664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.387121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.387547 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.449446 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:21.457408 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-550ba543-43db-4bfb-8866-5d7e0100eca5 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1144 microversion: 2.1 time: 0.083361 Aug 29 21:39:21.457976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 299/597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:21 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:21.647999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:21.648621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:21.654821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.655305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.655734 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.656414 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.656891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.657313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.789809 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:21.798403 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6f05f2ed-1cc1-4629-b964-815214bbae47 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.154682 Aug 29 21:39:21.798979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 299/598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:21 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:21.827196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:21.828000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:21.834122 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.834597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.835026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.835710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.836160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.836602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.970586 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:21.978949 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-956189bc-c953-411f-9dd0-9e307e2b859c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.156861 Aug 29 21:39:21.979508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 300/599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:21 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:22.478739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:22.479644 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:22.486247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.486518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.487073 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.487785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.488411 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.489291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.617719 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:22.626342 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6dcc0e42-788e-49fd-bcd4-b53d239b3a3c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1192 microversion: 2.1 time: 0.152136 Aug 29 21:39:22.627322 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 300/600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:22 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1192 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:22.821013 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:22.822098 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:22.829486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.829972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.830422 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.831097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.831542 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.831964 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.999966 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:23.000899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:23.007704 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:23.008187 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:23.008653 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.009445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:23.009848 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:23.010273 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.528844 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:23.544720 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1c6d8eda-8e77-4a29-b7cb-3be2c3df7d7b tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1521 microversion: 2.1 time: 0.727348 Aug 29 21:39:23.547577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 301/601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:22 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1521 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:23.631151 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:23.641627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-69802d26-ef44-4094-a3a7-ee412b9cd168 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.645370 Aug 29 21:39:23.642481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 301/602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:22 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:23.656792 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:23.656792 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:23.664607 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:23.665245 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:23.665688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.666433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:23.666891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:23.667374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.793158 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-922e59b3-1b2a-4a00-809f-1dd45221c46a req-c8c70733-5b33-4ee8-a52a-2e1a6464f96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be0d7ed-dc88-4a71-99f9-3509454cef5a", "name": "network-vif-deleted", "tag": "e0d83c82-29bf-4acb-9a84-0daa85948c1b"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:23.802138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:23.803443 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-922e59b3-1b2a-4a00-809f-1dd45221c46a req-c8c70733-5b33-4ee8-a52a-2e1a6464f96b service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:23.803994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-922e59b3-1b2a-4a00-809f-1dd45221c46a req-c8c70733-5b33-4ee8-a52a-2e1a6464f96b service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:23.804823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-922e59b3-1b2a-4a00-809f-1dd45221c46a req-c8c70733-5b33-4ee8-a52a-2e1a6464f96b service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.810680 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e3323f21-c7d3-4ed9-9cef-70d97ea980c3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1210 microversion: 2.1 time: 0.164809 Aug 29 21:39:23.818921 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-922e59b3-1b2a-4a00-809f-1dd45221c46a req-c8c70733-5b33-4ee8-a52a-2e1a6464f96b service nova] Creating event network-vif-deleted:e0d83c82-29bf-4acb-9a84-0daa85948c1b for instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a on hv-cinder-85426 Aug 29 21:39:23.825221 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-922e59b3-1b2a-4a00-809f-1dd45221c46a req-c8c70733-5b33-4ee8-a52a-2e1a6464f96b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036028 Aug 29 21:39:23.825918 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 302/603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:23 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1210 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:23.826473 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 302/604] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:24.568711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:24.570585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:24.583241 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.585661 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.586257 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.587482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.588045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.589150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.637309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.637954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.638476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.638994 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lazy-loading 'fault' on Instance uuid 6be0d7ed-dc88-4a71-99f9-3509454cef5a {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:24.667293 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:24.668548 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:24.676229 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.676819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.677315 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.678077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.678617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.679335 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.693104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344cf7b391d44beac2c602ac3e2e64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c7abc43eb142d3b36a6d91beee5d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:24.701565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-19044301-64d6-468d-baef-f710a1ebfd60 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 200 len: 1312 microversion: 2.1 time: 0.137470 Aug 29 21:39:24.702147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 303/605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:24 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 1312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:24.833462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:24.834073 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:24.840735 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.841471 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.842107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.842808 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.843612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.844385 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.926844 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:24.935151 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-499fe0bd-d6b7-46f5-bf14-d56d8dc06172 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.274059 Aug 29 21:39:24.935729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 303/606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:24 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:24.998905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:25.006573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4d39c824-c8d0-4d56-8d80-e1165fc85674 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.176863 Aug 29 21:39:25.007144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 304/607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:24 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:25.107035 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-d2bac7ee-5607-4b18-ae87-2aecc8b69a65 req-925df361-ce4f-4213-9547-f373912d119d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe03072e-8d13-4a8d-82f3-a40688588269", "tag": "acaaea14-ae8c-4840-97ee-5906201e9e88"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:25.128047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d2bac7ee-5607-4b18-ae87-2aecc8b69a65 req-925df361-ce4f-4213-9547-f373912d119d service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.135037 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d2bac7ee-5607-4b18-ae87-2aecc8b69a65 req-925df361-ce4f-4213-9547-f373912d119d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.135831 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-d2bac7ee-5607-4b18-ae87-2aecc8b69a65 req-925df361-ce4f-4213-9547-f373912d119d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.152341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-d2bac7ee-5607-4b18-ae87-2aecc8b69a65 req-925df361-ce4f-4213-9547-f373912d119d service nova] Creating event network-changed:acaaea14-ae8c-4840-97ee-5906201e9e88 for instance fe03072e-8d13-4a8d-82f3-a40688588269 on hv-cinder-85426 Aug 29 21:39:25.157869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-d2bac7ee-5607-4b18-ae87-2aecc8b69a65 req-925df361-ce4f-4213-9547-f373912d119d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055061 Aug 29 21:39:25.158721 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 304/608] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:25.723369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:25.723895 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] [instance: 6be0d7ed-dc88-4a71-99f9-3509454cef5a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:25.730202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.730684 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.731118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.731800 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.732249 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.732694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.747254 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] HTTP exception thrown: Instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a could not be found. Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Request method failure captured: Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a HTTP/1.1 Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZcJayaPMiVvOdb4QlD1aS9Nlrx6Ud6omWvPEIlFcBGr68ocnfX4OqlkiAD4SgTPp40rgWrvvVdXEKuKJV0IyMWnMNUyRa67hjywKRHUH9PKNHVT8hJ4qmm9XZYQ-vQMdzneL75fqS0xSfG_h0RCKaRx3ndFEnNDSuqeAe22J-D5c Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:39:25.749057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57c7abc43eb142d3b36a6d91beee5d10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57c7abc43eb142d3b36a6d91beee5d10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 57c7abc43eb142d3b36a6d91beee5d10 Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895828946 Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 5344cf7b391d44beac2c602ac3e2e64b Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895828946-project Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a could not be found. Aug 29 21:39:25.750664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '6be0d7ed-dc88-4a71-99f9-3509454cef5a'} Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a could not be found. Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:25.751481 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a could not be found. Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a could not be found. Aug 29 21:39:25.752810 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:25.753933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] Returning 404 to user: Instance 6be0d7ed-dc88-4a71-99f9-3509454cef5a could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:25.753933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ebffe56d-d2cc-4430-b6c2-34d86eab2338 tempest-ServerRescueNegativeTestJSON-895828946 tempest-ServerRescueNegativeTestJSON-895828946-project] 10.222.0.20 "GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a" status: 404 len: 111 microversion: 2.1 time: 0.031063 Aug 29 21:39:25.753933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 305/609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:25 2022] GET /compute/v2.1/servers/6be0d7ed-dc88-4a71-99f9-3509454cef5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:25.956475 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:25.957227 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:25.963904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.964398 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.965826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.966640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.967420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.967984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:26.027251 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:26.027867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:26.034291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:26.035080 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:26.035597 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:26.036295 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:26.036936 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:26.037513 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:26.271103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:26.278568 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:26.285431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-baf24c32-8f9e-4fe4-aede-6cd785c34193 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.261977 Aug 29 21:39:26.286016 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 306/610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:26 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:26.289597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d0f63fb7-7225-4f57-a2b8-6722b42b664a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.337452 Aug 29 21:39:26.290820 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 305/611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:25 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:26.652721 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:26.653311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:26.660788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:26.660788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:26.660788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:26.661304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:26.661977 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:26.662469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:26.687627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ba970f7a-b28d-423a-8293-813705438920 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/ips" status: 200 len: 152 microversion: 2.20 time: 0.103922 Aug 29 21:39:26.688521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 307/612] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 29 21:39:26 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/ips => generated 152 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:39:27.313178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:27.313840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:27.314205 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:27.314317 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:27.320575 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.320872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.321354 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.321470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.321785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.322063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.322474 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.322923 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.323042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.323336 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.323673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.324564 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.863312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:27.870493 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:27.870957 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-effd44b5-d7ac-4f81-8704-6af809a4f11e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.561656 Aug 29 21:39:27.871904 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 308/613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:27 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:27.893971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-75fd6741-0f96-4877-bb72-c2f5623728fd tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.584413 Aug 29 21:39:27.900016 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 306/614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:27 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:28.242230 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-430a7a9c-fd6e-4dbe-bf89-0ac2794d73e6 req-e2fc4f14-c65e-40e5-aad0-1a63110533d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cf2d9d-c660-4fb2-a97d-b14d667481ad", "name": "network-vif-plugged", "status": "completed", "tag": "b0874f96-e644-4660-bee2-6988edf50b89"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:28.252196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-430a7a9c-fd6e-4dbe-bf89-0ac2794d73e6 req-e2fc4f14-c65e-40e5-aad0-1a63110533d9 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.253070 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-430a7a9c-fd6e-4dbe-bf89-0ac2794d73e6 req-e2fc4f14-c65e-40e5-aad0-1a63110533d9 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.253737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-430a7a9c-fd6e-4dbe-bf89-0ac2794d73e6 req-e2fc4f14-c65e-40e5-aad0-1a63110533d9 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:28.269052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-430a7a9c-fd6e-4dbe-bf89-0ac2794d73e6 req-e2fc4f14-c65e-40e5-aad0-1a63110533d9 service nova] Creating event network-vif-plugged:b0874f96-e644-4660-bee2-6988edf50b89 for instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad on hv-cinder-85426 Aug 29 21:39:28.276447 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-430a7a9c-fd6e-4dbe-bf89-0ac2794d73e6 req-e2fc4f14-c65e-40e5-aad0-1a63110533d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037713 Aug 29 21:39:28.277399 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 309/615] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:28.896975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:28.897635 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:28.911690 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.912771 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.913218 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:28.913929 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.914386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.914808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:28.920650 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:28.924123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:28.935965 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.936275 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=100 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:28.937471 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.937980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:28.940913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.941222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.941662 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:29.139470 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.150560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b756c79e-d253-4d82-b7e1-96c134ac5936 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.262216 Aug 29 21:39:29.151324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 307/616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:28 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:29.158074 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:29.159015 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:29.165967 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:29.166486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:29.166943 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:29.167890 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:29.168406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:29.168900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:29.182858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.192146 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6a608440-5301-4428-93ec-8b646bbfa305 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.278508 Aug 29 21:39:29.192871 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 310/617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:28 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:29.197652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lazy-loading 'flavor' on Instance uuid 11491cff-58f2-4d90-ae11-471c65c47bcb {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:29.410877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6e2cfcb7-6ed8-4f2b-97d6-fc36b15d7622 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/action" status: 202 len: 0 microversion: 2.20 time: 0.257392 Aug 29 21:39:29.411701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 308/618] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 21:39:29 2022] POST /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:29.419804 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:29.420424 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:29.427137 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:29.427930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:29.428670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:29.429623 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:29.430330 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:29.431506 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:29.604778 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.620260 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.623974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.629347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a9cffdba-e4df-4b13-bc3c-138be4c04265 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.213191 Aug 29 21:39:29.631801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 311/619] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:29 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:30.173047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:30.173872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:30.180011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.180493 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.181208 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.181915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.182365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.182967 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.215209 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:30.216462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:30.220222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:30.221215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=28 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:30.225803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.226293 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.226724 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.227552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.228673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.229369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.248856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:30.353619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:30.436974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.445571 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-200e3128-9022-4783-90cb-58a1a3db19a2 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.277327 Aug 29 21:39:30.451896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 309/620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:30 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:30.476692 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.486086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-12c7dac0-7b22-4d11-af0e-45e09ee64511 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1366 microversion: 2.1 time: 0.275414 Aug 29 21:39:30.486698 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 312/621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:30 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:30.654787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:30.655391 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:30.662313 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.662804 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.663976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.664863 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.665319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.665739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.819135 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.829413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.830965 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.832233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bd175386-f034-4d20-94db-d586fff4a257 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.181381 Aug 29 21:39:30.832811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 310/622] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:30 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:31.467634 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:31.468399 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.471109 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:31.476534 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.477071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.478223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.478794 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.479266 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.479653 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.508469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:31.510311 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.521298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.521783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.522406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.523096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.523826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.524678 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.692320 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:31.704439 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5be6d857-2532-4781-aa35-1780be4fbfb7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.240585 Aug 29 21:39:31.705835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 313/623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:31 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:31.723951 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:31.733364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a6999d88-901b-4fea-bfd4-6f64e3779fc5 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1556 microversion: 2.1 time: 0.230785 Aug 29 21:39:31.734195 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 311/624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:31 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:31.766874 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:31.767404 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.773782 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.774766 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.775418 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.776129 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.776611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.777041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.855313 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:31.856479 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.863287 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e495bded-cb88-4a24-be36-e6b87f572ad4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100461 Aug 29 21:39:31.864045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 314/625] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 21:39:31 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:31.865891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.866389 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.866829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.867751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.868387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.869012 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:32.131975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:32.142514 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:32.144681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:32.145851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-59af92fa-b91a-4fa3-ad26-779f522eedc8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.294512 Aug 29 21:39:32.146435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 312/626] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:31 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:32.741018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:32.741663 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:32.750494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:32.751018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:32.751463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:32.752176 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:32.752666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:32.753098 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:32.974281 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:32.982894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-76cdc8ba-d8be-42f3-afba-4a183c4b8d7e tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.246246 Aug 29 21:39:32.983733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 315/627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:32 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:33.089902 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-80dd5148-77b4-4124-8025-a567808d29e2 req-318f186c-6409-4450-94ef-c62f65b92f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cf2d9d-c660-4fb2-a97d-b14d667481ad", "tag": "b0874f96-e644-4660-bee2-6988edf50b89"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:33.100205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-80dd5148-77b4-4124-8025-a567808d29e2 req-318f186c-6409-4450-94ef-c62f65b92f07 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.101072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-80dd5148-77b4-4124-8025-a567808d29e2 req-318f186c-6409-4450-94ef-c62f65b92f07 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.101566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-80dd5148-77b4-4124-8025-a567808d29e2 req-318f186c-6409-4450-94ef-c62f65b92f07 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.114891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-80dd5148-77b4-4124-8025-a567808d29e2 req-318f186c-6409-4450-94ef-c62f65b92f07 service nova] Creating event network-changed:b0874f96-e644-4660-bee2-6988edf50b89 for instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad on hv-cinder-85426 Aug 29 21:39:33.120529 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-80dd5148-77b4-4124-8025-a567808d29e2 req-318f186c-6409-4450-94ef-c62f65b92f07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035906 Aug 29 21:39:33.121634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 313/628] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:33.170593 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:33.172330 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:33.181311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.182679 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.183280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.184673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.185456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.186431 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.364743 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:33.373713 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:33.375153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:33.377497 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d6c8e83c-41b9-46e1-be1e-b386f81e69d8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.211942 Aug 29 21:39:33.378867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 316/629] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:33 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:34.003911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:34.004520 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.011528 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.012083 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.012569 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.013298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.013748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.014553 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.179254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.189090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5dbd35bd-83ad-48e6-b363-b613511cde42 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.189360 Aug 29 21:39:34.189676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 314/630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:33 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:34.280491 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-4bf1fa7a-5bdc-4247-afdf-77a8519d499f req-e5185895-df57-4f23-8ceb-26741b4c2ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe03072e-8d13-4a8d-82f3-a40688588269", "name": "network-vif-plugged", "status": "completed", "tag": "acaaea14-ae8c-4840-97ee-5906201e9e88"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:34.291241 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4bf1fa7a-5bdc-4247-afdf-77a8519d499f req-e5185895-df57-4f23-8ceb-26741b4c2ba7 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.292121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4bf1fa7a-5bdc-4247-afdf-77a8519d499f req-e5185895-df57-4f23-8ceb-26741b4c2ba7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.292463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4bf1fa7a-5bdc-4247-afdf-77a8519d499f req-e5185895-df57-4f23-8ceb-26741b4c2ba7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.312251 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-4bf1fa7a-5bdc-4247-afdf-77a8519d499f req-e5185895-df57-4f23-8ceb-26741b4c2ba7 service nova] Creating event network-vif-plugged:acaaea14-ae8c-4840-97ee-5906201e9e88 for instance fe03072e-8d13-4a8d-82f3-a40688588269 on hv-cinder-85426 Aug 29 21:39:34.319512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-4bf1fa7a-5bdc-4247-afdf-77a8519d499f req-e5185895-df57-4f23-8ceb-26741b4c2ba7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042738 Aug 29 21:39:34.320152 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 317/631] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:34.401409 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:34.402484 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.408925 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.409644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.410368 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.411380 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.411984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.412702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.579679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.588283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.589848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.591030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-71c8b259-b691-47e4-a483-383930a9b1fe tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.193997 Aug 29 21:39:34.591597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 315/632] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:34 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:35.210556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:35.211247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:35.217828 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.218313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.218745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.219429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.219881 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.220298 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.356987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.365018 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-be58a92a-f98a-40ba-a8c4-96b8e4f793d0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1265 microversion: 2.1 time: 0.158496 Aug 29 21:39:35.365587 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 318/633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:35 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:35.614293 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:35.614992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:35.621473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.622037 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.622573 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.623789 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.623891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.624379 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.762877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.771968 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.773633 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.775584 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-831cd09e-d436-4354-959e-084eabfd605f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.165299 Aug 29 21:39:35.776320 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 316/634] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:35 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:36.385849 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.386557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.393233 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.393815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.394146 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.394847 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.395305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.395736 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.577524 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:36.585420 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d55745a5-0659-4a16-b55c-0def0cddf777 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1451 microversion: 2.1 time: 0.203323 Aug 29 21:39:36.586193 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 319/635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:36 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1451 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:36.607486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.608101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.614176 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.614666 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.615246 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.615787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.616248 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.616702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.757438 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:36.765474 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7b55adfc-6ff4-4c2d-b35a-76cca6760bc7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1451 microversion: 2.1 time: 0.163070 Aug 29 21:39:36.766046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 317/636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:36 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:36.800468 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.801185 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.810142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.811060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.812244 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.813142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.813739 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.814289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.070222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.081336 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.083071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.084310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a14d5b8c-f130-4a05-8cf0-a255d1ba5251 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.287934 Aug 29 21:39:37.084970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 320/637] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:36 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:39:38.108540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:38.109285 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:38.116378 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:38.117042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:38.121344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:38.121344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:38.121344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:38.121344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:38.347014 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:38.356928 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:38.358739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:38.359924 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3c3dc884-b5da-4cd5-b352-30af47a91827 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.256109 Aug 29 21:39:38.360487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 318/638] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:38 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:39.025674 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-439e7bae-0fe0-437e-a1b1-d3b9017eb2be req-cc2d3552-7e23-4f8a-836f-d0309eb7bd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe03072e-8d13-4a8d-82f3-a40688588269", "tag": "acaaea14-ae8c-4840-97ee-5906201e9e88"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:39.035836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-439e7bae-0fe0-437e-a1b1-d3b9017eb2be req-cc2d3552-7e23-4f8a-836f-d0309eb7bd3f service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.036310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-439e7bae-0fe0-437e-a1b1-d3b9017eb2be req-cc2d3552-7e23-4f8a-836f-d0309eb7bd3f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.036766 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-439e7bae-0fe0-437e-a1b1-d3b9017eb2be req-cc2d3552-7e23-4f8a-836f-d0309eb7bd3f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.049517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-439e7bae-0fe0-437e-a1b1-d3b9017eb2be req-cc2d3552-7e23-4f8a-836f-d0309eb7bd3f service nova] Creating event network-changed:acaaea14-ae8c-4840-97ee-5906201e9e88 for instance fe03072e-8d13-4a8d-82f3-a40688588269 on hv-cinder-85426 Aug 29 21:39:39.055088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-439e7bae-0fe0-437e-a1b1-d3b9017eb2be req-cc2d3552-7e23-4f8a-836f-d0309eb7bd3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033019 Aug 29 21:39:39.056331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 321/639] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:39.383436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:39.384702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:39.392888 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.393603 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.394201 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.395063 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.395676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.396260 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.555198 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:39.564346 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:39.565837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:39.567013 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4f68db79-3fa5-446e-917b-20f2425369cd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.187699 Aug 29 21:39:39.567597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 319/640] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:39 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:40.592462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:40.593479 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:40.600522 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.601329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.601722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.602476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.602940 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.603402 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.770278 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:40.779984 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:40.781487 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:40.782923 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ec8e8165-5f1e-454f-9012-13717764db1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1746 microversion: 2.20 time: 0.196306 Aug 29 21:39:40.797220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 322/641] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:40 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:41.808053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:41.809138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:41.815282 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:41.815759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:41.816186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:41.816903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:41.817350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:41.817770 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:41.958172 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:41.967442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:41.968942 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:41.970117 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d30e75a8-301f-4470-b2cd-86e5d05d1e8c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1746 microversion: 2.20 time: 0.166653 Aug 29 21:39:41.970679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 320/642] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:41 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:42.353557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1761965542", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "networks": [{"uuid": "78c101bb-e30d-4754-b493-6344068092ae"}]}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:42.410406 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] validate_networks() for [('78c101bb-e30d-4754-b493-6344068092ae', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:39:42.846296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:39:42.847335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:39:42.847819 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:39:42.848305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:39:42.848745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:39:42.860913 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.861403 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.861840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:42.862754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.863537 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.863643 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:42.881730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Getting quotas for project cfe1d306716f49be9c1171a3b83d68f3. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:42.887482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Getting quotas for user d22dd55b03a44014ba9e52ab79164eeb and project cfe1d306716f49be9c1171a3b83d68f3. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:42.905398 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:39:42.909782 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:39:42.966601 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5d55e7b8-9df1-4671-a4c7-ccf25b99c097 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617107 Aug 29 21:39:42.967517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 323/643] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:39:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:39:42.979294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-932a7303-c73a-4ee6-bd09-47b157db572f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:42.979896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-932a7303-c73a-4ee6-bd09-47b157db572f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:42.994823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:42.996042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:43.011611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.012116 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.012558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.013300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.013762 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.014444 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.050042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-932a7303-c73a-4ee6-bd09-47b157db572f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:43.058055 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-932a7303-c73a-4ee6-bd09-47b157db572f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1214 microversion: 2.1 time: 0.083117 Aug 29 21:39:43.058643 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 321/644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:42 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:43.194515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:43.205035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:43.206320 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:43.207575 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-94cd8c73-d760-41a0-a1c9-3130ad61e083 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.217757 Aug 29 21:39:43.208334 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 324/645] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:42 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:44.081394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:44.083245 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:44.094287 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.095208 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.096332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.097120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.107149 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.109184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.232819 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:44.233528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:44.241782 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:44.252346 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-60811ca0-0c0f-4cb7-b5dc-884ade4510ca tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1266 microversion: 2.1 time: 0.176133 Aug 29 21:39:44.253627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 322/646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:44 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:44.254509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.255012 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.255456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.256255 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.260034 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.266263 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.362105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-89d007a5-5b05-4c34-b798-c143d18326bd req-fa336703-bd9e-498d-8ffb-f40088ddab84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11491cff-58f2-4d90-ae11-471c65c47bcb", "name": "network-vif-plugged", "status": "completed", "tag": "d22eeab8-4235-4014-83a9-d0d8e059e752"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:44.374329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-89d007a5-5b05-4c34-b798-c143d18326bd req-fa336703-bd9e-498d-8ffb-f40088ddab84 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.375092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-89d007a5-5b05-4c34-b798-c143d18326bd req-fa336703-bd9e-498d-8ffb-f40088ddab84 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.375853 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-89d007a5-5b05-4c34-b798-c143d18326bd req-fa336703-bd9e-498d-8ffb-f40088ddab84 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.415931 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-89d007a5-5b05-4c34-b798-c143d18326bd req-fa336703-bd9e-498d-8ffb-f40088ddab84 service nova] Creating event network-vif-plugged:d22eeab8-4235-4014-83a9-d0d8e059e752 for instance 11491cff-58f2-4d90-ae11-471c65c47bcb on hv-cinder-85426 Aug 29 21:39:44.423120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-89d007a5-5b05-4c34-b798-c143d18326bd req-fa336703-bd9e-498d-8ffb-f40088ddab84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064568 Aug 29 21:39:44.424154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 323/647] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:44.521313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:44.533299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:44.535974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:44.537490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-02b7f274-1b42-49ce-a5bf-be74d86ddebf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.309103 Aug 29 21:39:44.538386 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 325/648] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:44 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:45.278521 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:45.279388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:45.301840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.302719 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.303396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.304318 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.305256 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.305906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.334437 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:45.397634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:45.412807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-36f61ab0-3392-48fa-8b0a-8e4f12658115 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1272 microversion: 2.1 time: 0.140645 Aug 29 21:39:45.414600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 324/649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:45 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:45.565614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:45.566478 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:45.573513 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.574637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.575749 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.576840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.577643 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.578293 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.794338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:45.805055 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:45.807042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:45.808609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2272cc13-fa4e-4995-ba10-dbeb7b0e70dd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.247651 Aug 29 21:39:45.809225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 326/650] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:45 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:46.452699 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:46.457635 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:46.478319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:46.478955 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:46.480468 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:46.481526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:46.482030 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:46.482472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:46.687811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-aed3aa40-04a8-4dc9-8e3d-0815a441f90e req-80db822d-8267-4895-b6a7-2334f95fb362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0b6723-8bf1-419b-87d9-223d28a6e57c", "tag": "85127093-2ea6-4cab-9379-3c35926b9c42"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:46.708186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-aed3aa40-04a8-4dc9-8e3d-0815a441f90e req-80db822d-8267-4895-b6a7-2334f95fb362 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:46.708712 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-aed3aa40-04a8-4dc9-8e3d-0815a441f90e req-80db822d-8267-4895-b6a7-2334f95fb362 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:46.709224 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-aed3aa40-04a8-4dc9-8e3d-0815a441f90e req-80db822d-8267-4895-b6a7-2334f95fb362 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:46.724142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:46.727365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-aed3aa40-04a8-4dc9-8e3d-0815a441f90e req-80db822d-8267-4895-b6a7-2334f95fb362 service nova] Creating event network-changed:85127093-2ea6-4cab-9379-3c35926b9c42 for instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c on hv-cinder-85426 Aug 29 21:39:46.732473 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-aed3aa40-04a8-4dc9-8e3d-0815a441f90e req-80db822d-8267-4895-b6a7-2334f95fb362 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294325 Aug 29 21:39:46.733443 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 325/651] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:46.738747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9d1e3beb-9b28-4b28-ba8d-482fa7b53eb8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1314 microversion: 2.1 time: 0.300069 Aug 29 21:39:46.739333 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 327/652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:46 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:46.835866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:46.836964 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:46.844677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:46.846764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:46.847247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:46.847988 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:46.848452 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:46.848920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:47.005897 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:47.023213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:47.024758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:47.025954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e66d1f3a-398c-44f9-8869-94750f764a1f tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.195894 Aug 29 21:39:47.032051 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 326/653] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:46 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:47.760071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:47.760900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:47.768097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:47.768630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:47.769270 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:47.770208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:47.770902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:47.771373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:47.955501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:47.967246 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-914874c7-dae7-407c-893e-64919321d147 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1314 microversion: 2.1 time: 0.211116 Aug 29 21:39:47.968482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 328/654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:47 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:48.053599 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:48.054360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:48.061549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:48.062168 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:48.062483 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:48.063180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:48.063634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:48.064056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:48.287197 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:48.298488 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:48.300063 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:48.302244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f4baae5c-c463-4a6f-9316-c2ca422e94c8 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.252491 Aug 29 21:39:48.303056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 327/655] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:48 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:48.987609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:48.988209 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:48.994727 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:48.995455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:48.996077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:48.997501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:48.998161 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:48.998936 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:49.179612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:49.189238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c9d2b03e-0a89-445f-96c9-8df849aa193c tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1314 microversion: 2.1 time: 0.205265 Aug 29 21:39:49.189870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 329/656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:48 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:49.328982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:49.330371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:49.337673 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:49.338703 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:49.339142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:49.339892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:49.340366 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:49.340819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:49.523424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:49.532915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:49.534412 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:49.535661 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4f581b9d-0d5a-4f09-84c1-e47d179bc49a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.211038 Aug 29 21:39:49.536248 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 328/657] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:49 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:50.214553 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:50.216283 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:50.224196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:50.225096 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:50.226006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:50.227323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:50.228163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:50.228657 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:50.426563 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-8ebddfdb-0f2a-4eaf-b7bd-bdd9c20929a4 req-8318d454-4239-4cd3-a2a1-5b5392c8e2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0b6723-8bf1-419b-87d9-223d28a6e57c", "name": "network-vif-plugged", "status": "completed", "tag": "85127093-2ea6-4cab-9379-3c35926b9c42"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:50.435111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:50.438676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=72 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:50.442033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-8ebddfdb-0f2a-4eaf-b7bd-bdd9c20929a4 req-8318d454-4239-4cd3-a2a1-5b5392c8e2ef service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:50.442873 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-8ebddfdb-0f2a-4eaf-b7bd-bdd9c20929a4 req-8318d454-4239-4cd3-a2a1-5b5392c8e2ef service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:50.443625 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-8ebddfdb-0f2a-4eaf-b7bd-bdd9c20929a4 req-8318d454-4239-4cd3-a2a1-5b5392c8e2ef service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:50.445628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0e221860-f0f5-4935-bcbc-a2b598c8c284 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1314 microversion: 2.1 time: 0.238787 Aug 29 21:39:50.459770 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 330/658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:50 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:50.465364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-8ebddfdb-0f2a-4eaf-b7bd-bdd9c20929a4 req-8318d454-4239-4cd3-a2a1-5b5392c8e2ef service nova] Creating event network-vif-plugged:85127093-2ea6-4cab-9379-3c35926b9c42 for instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c on hv-cinder-85426 Aug 29 21:39:50.471956 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-8ebddfdb-0f2a-4eaf-b7bd-bdd9c20929a4 req-8318d454-4239-4cd3-a2a1-5b5392c8e2ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049583 Aug 29 21:39:50.473130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 329/659] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:50.564104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:50.565192 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:50.576876 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:50.577874 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:50.578705 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:50.579775 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:50.580417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:50.581060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:50.617789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=100 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:50.766829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:50.776876 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:50.778573 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:50.780057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d4cac719-1047-41a9-9325-fc34e3acc1d7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.220323 Aug 29 21:39:50.781577 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 331/660] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:50 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:51.472197 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:51.473000 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:51.482877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:51.483815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:51.484441 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:51.485288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:51.485754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:51.486186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:51.653308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:51.663255 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ef7314a1-191d-4db3-b9c5-bb0e3289aef8 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1314 microversion: 2.1 time: 0.199773 Aug 29 21:39:51.664566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 330/661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:51 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:51.806217 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:51.807096 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:51.814211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:51.814765 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:51.815309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:51.816098 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:51.816682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:51.817198 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:51.992043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:52.005112 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:52.007088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:52.008523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-72e9f05e-4d05-44a9-b986-8944cf768dc3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.206543 Aug 29 21:39:52.009503 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 332/662] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:51 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:52.693560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:52.695583 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:52.705377 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:52.706188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:52.706635 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:52.707346 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:52.708023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:52.708856 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:52.902409 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:52.912519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2ab063aa-f47e-42cd-bfb0-1819fed9e2e2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1314 microversion: 2.1 time: 0.226773 Aug 29 21:39:52.913387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 331/663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:52 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:53.038814 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:53.039482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:53.042280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:53.043042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:53.050430 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:53.050916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:53.051347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:53.052223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:53.052697 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:53.053282 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:53.198261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:53.206931 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:53.208435 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:53.209660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-64a58e9e-9b7f-4e17-9bb3-01fefbaa4505 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1741 microversion: 2.20 time: 0.174989 Aug 29 21:39:53.210221 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 333/664] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:53 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:53.935663 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:53.936280 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:53.938372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:53.944859 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:53.945376 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:53.945812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:53.946519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:53.946974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:53.947396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.089131 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:54.102428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1ec1e3c1-366f-482a-bb26-37bb7a97db04 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1499 microversion: 2.1 time: 0.170270 Aug 29 21:39:54.103407 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 332/665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:53 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:54.235552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:54.236837 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:54.245729 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.246319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.246800 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.247584 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.248092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.248909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.432867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:54.440937 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:54.442533 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:54.443683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a94a807a-f0b7-42e4-81c4-341fae6436e5 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1723 microversion: 2.20 time: 0.213875 Aug 29 21:39:54.444244 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 334/666] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:54 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:54.580252 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:54.580804 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:54.587590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.588080 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.588541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.589989 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.589989 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.590204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.615330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:54.690150 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e00621f9-e0c7-4ffe-aeb8-aab4adbf48f6 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 204 len: 0 microversion: 2.1 time: 0.113517 Aug 29 21:39:54.690732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 333/667] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:54 2022] DELETE /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:54.699633 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:54.700266 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:54.706477 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.706964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.707401 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.708099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.708554 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.709005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.850341 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:54.858224 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-205e521e-76ff-4570-bfb1-da205d5f7586 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1505 microversion: 2.1 time: 0.163052 Aug 29 21:39:54.858791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 335/668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:54 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:55.468454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:55.469486 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:55.477279 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:55.477752 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:55.478188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:55.478894 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:55.479338 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:55.479755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:55.615295 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:55.623518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:55.624993 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:55.626154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-37700807-644b-4141-b24f-81be18b94f58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1723 microversion: 2.20 time: 0.162064 Aug 29 21:39:55.626745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 334/669] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:55 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:55.879456 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:55.880092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:55.887823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:55.888963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:55.889645 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:55.890653 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:55.891303 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:55.891952 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:56.025345 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:56.033933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7f337802-ed6b-4141-a2c7-a2f2251fdb50 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1505 microversion: 2.1 time: 0.158505 Aug 29 21:39:56.034503 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 336/670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:55 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:56.373236 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-52717e7b-3bd8-44c4-b6d8-f472721522ff req-6323de3e-99ff-492b-85ff-1b2b19869a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11491cff-58f2-4d90-ae11-471c65c47bcb", "name": "network-vif-unplugged", "status": "completed", "tag": "d22eeab8-4235-4014-83a9-d0d8e059e752"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:56.383639 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-52717e7b-3bd8-44c4-b6d8-f472721522ff req-6323de3e-99ff-492b-85ff-1b2b19869a03 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:56.384317 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-52717e7b-3bd8-44c4-b6d8-f472721522ff req-6323de3e-99ff-492b-85ff-1b2b19869a03 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:56.384555 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-52717e7b-3bd8-44c4-b6d8-f472721522ff req-6323de3e-99ff-492b-85ff-1b2b19869a03 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:56.395880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-52717e7b-3bd8-44c4-b6d8-f472721522ff req-6323de3e-99ff-492b-85ff-1b2b19869a03 service nova] Creating event network-vif-unplugged:d22eeab8-4235-4014-83a9-d0d8e059e752 for instance 11491cff-58f2-4d90-ae11-471c65c47bcb on hv-cinder-85426 Aug 29 21:39:56.400728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-52717e7b-3bd8-44c4-b6d8-f472721522ff req-6323de3e-99ff-492b-85ff-1b2b19869a03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090765 Aug 29 21:39:56.401333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 335/671] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:56.649124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:56.649756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:56.656098 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:56.656597 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:56.657040 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:56.657728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:56.658180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:56.658596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:56.800866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:56.809805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:56.811257 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:56.812464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-286549cb-4cb1-48c8-b208-9bd6e0d35526 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1723 microversion: 2.20 time: 0.167271 Aug 29 21:39:56.813101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 337/672] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:56 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:57.055848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:57.056571 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:57.063183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:57.063698 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:57.064133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:57.064875 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:57.065328 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:57.065753 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:57.196295 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:57.204261 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-078893d5-1e02-40b7-ad8b-b2426a0e1644 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1505 microversion: 2.1 time: 0.153052 Aug 29 21:39:57.204864 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 336/673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:57 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:57.835638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:57.836164 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:57.842606 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:57.843091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:57.843528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:57.844221 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:57.844708 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:57.845133 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.009792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:58.019349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:58.020846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:58.022045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e47e72f2-da81-4497-981d-bc80499db62b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1726 microversion: 2.20 time: 0.190633 Aug 29 21:39:58.022603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 338/674] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:57 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:58.045624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f79cfe94-5c8a-491a-b901-87d6b2b1ae2e"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:58.048350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:58.056259 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.056971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.057322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.058270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.058736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.059163 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.225538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:58.226159 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:58.233673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.234578 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.234578 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.235297 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.235755 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.236178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.404226 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-60a9e02d-6cb3-45ed-b8d8-f5371bcfb68c tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362976 Aug 29 21:39:58.405470 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 337/675] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 29 21:39:58 2022] POST /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-volume_attachments => generated 188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:39:58.434939 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:58.446803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e18e0121-d8e2-42e4-884c-d7bc1da7c130 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 200 len: 1505 microversion: 2.1 time: 0.222870 Aug 29 21:39:58.446803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 339/676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:58 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:58.552076 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:58.552576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:58.560412 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.561003 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.561507 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.562216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.562660 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.563080 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.566603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-a4de7e34-e2cc-4199-b527-abad3b974ea9 req-81331ee6-9e02-4790-ad52-11b8ae935787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0b6723-8bf1-419b-87d9-223d28a6e57c", "name": "network-vif-deleted", "tag": "85127093-2ea6-4cab-9379-3c35926b9c42"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:58.577125 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a4de7e34-e2cc-4199-b527-abad3b974ea9 req-81331ee6-9e02-4790-ad52-11b8ae935787 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.577649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a4de7e34-e2cc-4199-b527-abad3b974ea9 req-81331ee6-9e02-4790-ad52-11b8ae935787 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.578092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a4de7e34-e2cc-4199-b527-abad3b974ea9 req-81331ee6-9e02-4790-ad52-11b8ae935787 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.590822 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-a4de7e34-e2cc-4199-b527-abad3b974ea9 req-81331ee6-9e02-4790-ad52-11b8ae935787 service nova] Creating event network-vif-deleted:85127093-2ea6-4cab-9379-3c35926b9c42 for instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c on hv-cinder-85426 Aug 29 21:39:58.596542 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-a4de7e34-e2cc-4199-b527-abad3b974ea9 req-81331ee6-9e02-4790-ad52-11b8ae935787 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033404 Aug 29 21:39:58.597538 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 340/677] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:58.702464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:58.867478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b877ec59-e912-4a3c-8957-d9a5c97ad28d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-volume_attachments/f79cfe94-5c8a-491a-b901-87d6b2b1ae2e" status: 202 len: 0 microversion: 2.20 time: 0.319379 Aug 29 21:39:58.868077 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 338/678] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 29 21:39:58 2022] DELETE /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-volume_attachments/f79cfe94-5c8a-491a-b901-87d6b2b1ae2e => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:58.936697 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:58.937389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:58.943846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.944343 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.944831 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.946173 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.946634 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.947065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.994998 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127217) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:39:59.069452 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0ee31b61-1adc-4b54-8f5f-bb3c01efde55 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "POST /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/action" status: 202 len: 0 microversion: 2.20 time: 0.137734 Aug 29 21:39:59.070350 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 341/679] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 21:39:58 2022] POST /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:59.079226 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:59.079947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:59.086974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.087464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.087907 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.088625 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.089309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.089519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.255283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:59.265394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:59.267136 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:59.269317 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-56c4d623-8435-4150-a726-30930a8468e0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1674 microversion: 2.20 time: 0.193991 Aug 29 21:39:59.270407 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 339/680] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:59 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:59.466188 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:59.466798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 2c0b6723-8bf1-419b-87d9-223d28a6e57c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:59.472796 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.473288 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.473721 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.474500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.475009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.475429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.495866 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] HTTP exception thrown: Instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c could not be found. Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Request method failure captured: Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c HTTP/1.1 Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTIc1Z4iSjb3gBBfYzmMUb1l-hr4vtJAquNjhJU3JCHSWZwREjcyb4mZU3dRii7SEwzCX-X1kG8fD4AEKnx71wt24jODq4ngVObnqKBJ8y_X5ej3jdcF9h80hDBYhYLpzCbPVBV4rTn8x76nBTmKSR_LJJJaRXCqgX2t2mXH4AXA3iU Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: cfe1d306716f49be9c1171a3b83d68f3 Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesActionsTest-806010808 Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:39:59.498214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cfe1d306716f49be9c1171a3b83d68f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfe1d306716f49be9c1171a3b83d68f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfe1d306716f49be9c1171a3b83d68f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cfe1d306716f49be9c1171a3b83d68f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesActionsTest-806010808 Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: cfe1d306716f49be9c1171a3b83d68f3 Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesActionsTest-806010808 Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesActionsTest-806010808-project Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: d22dd55b03a44014ba9e52ab79164eeb Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesActionsTest-806010808-project Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c could not be found. Aug 29 21:39:59.500157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '2c0b6723-8bf1-419b-87d9-223d28a6e57c'} Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c could not be found. Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:59.501294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c could not be found. Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c could not be found. Aug 29 21:39:59.503006 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:39:59.504714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Returning 404 to user: Instance 2c0b6723-8bf1-419b-87d9-223d28a6e57c could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:59.504714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-41dd4b98-1215-4c64-93ac-9338e4d5d9c7 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c" status: 404 len: 111 microversion: 2.1 time: 0.037730 Aug 29 21:39:59.511747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 342/681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:59 2022] GET /compute/v2.1/servers/2c0b6723-8bf1-419b-87d9-223d28a6e57c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:59.560674 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-529667813", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "networks": [{"uuid": "78c101bb-e30d-4754-b493-6344068092ae"}]}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:59.622835 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] validate_networks() for [('78c101bb-e30d-4754-b493-6344068092ae', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:40:00.088379 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:40:00.089276 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:40:00.089909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:40:00.090394 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:40:00.090823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:40:00.099940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.100425 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.100906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.102361 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.103007 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.103618 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.121926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Getting quotas for project cfe1d306716f49be9c1171a3b83d68f3. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:40:00.126266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Getting quotas for user d22dd55b03a44014ba9e52ab79164eeb and project cfe1d306716f49be9c1171a3b83d68f3. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:40:00.137948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:40:00.140508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:40:00.190522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-246837fe-68ca-4e6b-8916-fbf694dca92a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633707 Aug 29 21:40:00.197178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 340/682] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:39:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:40:00.202500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d1b56bc8-9fb1-4195-8ad4-d68accc07526 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:00.203215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d1b56bc8-9fb1-4195-8ad4-d68accc07526 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:00.266541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d1b56bc8-9fb1-4195-8ad4-d68accc07526 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:00.275910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d1b56bc8-9fb1-4195-8ad4-d68accc07526 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1213 microversion: 2.1 time: 0.077219 Aug 29 21:40:00.276521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 343/683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:00 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:00.297142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:00.297796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:00.304869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.305359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.306005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.306747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.307201 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.307825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.468963 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:00.484219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:00.485802 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:00.487331 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4be2dce0-b9b1-495b-89a5-ce1ab56c1c67 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1676 microversion: 2.20 time: 0.194589 Aug 29 21:40:00.493175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 341/684] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:00 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:01.299365 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:01.300175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:01.308429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:01.309001 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:01.309438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:01.310154 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:01.310604 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:01.311054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:01.376103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:01.385280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d0e67deb-79bb-4523-bdae-9c07400fcff0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1265 microversion: 2.1 time: 0.089905 Aug 29 21:40:01.385954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 344/685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:01 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:01.513041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:01.513912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:01.520684 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:01.521176 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:01.521614 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:01.522316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:01.522767 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:01.523191 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:01.986783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:01.995830 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:01.997625 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:01.999130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7685ad5d-80d7-4084-942c-0c3e4f752c0b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.490191 Aug 29 21:40:01.999687 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 342/686] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:01 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:02.407763 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:02.409063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:02.417466 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:02.422090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.422606 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.423048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.426393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.428057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.428628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.572794 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:02.587995 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1838a6df-064d-4736-bf05-1b6771ee226b tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1271 microversion: 2.1 time: 0.184407 Aug 29 21:40:02.596517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 345/687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:02 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:03.024222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:03.024899 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:03.030933 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.031432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.031864 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.032616 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.033079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.033504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.175277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:03.183743 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:03.185266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:03.186398 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-42b9dd5d-d466-464c-911d-85ed346262f6 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.166958 Aug 29 21:40:03.186951 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 343/688] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:03 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:03.612620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:03.614097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:03.621318 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.621852 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.622292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.623256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.623758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.624364 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.789088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:03.796329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:03.796847 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:03.798646 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-78d656d8-a400-4cda-8933-701482f7f2fe tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.190709 Aug 29 21:40:03.799318 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 346/689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:03 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:03.808714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.808714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.808714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.814062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.814062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.814062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.837776 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-91b81e63-191b-4848-8032-a420a934c8a8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/ips" status: 200 len: 146 microversion: 2.1 time: 0.214102 Aug 29 21:40:03.838342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 344/690] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:40:03 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/ips => generated 146 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:04.214302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:04.215277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:04.221590 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.222083 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.222520 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.223225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.223677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.224106 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.371696 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:04.380297 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:04.381872 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:04.383479 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-474991da-7b33-4b55-a2ce-6af34d1af2a4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.177927 Aug 29 21:40:04.384035 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 347/691] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:04 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:04.821267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:04.821887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:04.831465 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.832184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.833006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.834214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.834670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.835400 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.047896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:05.057193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-42cac363-7195-47b2-b0c1-2109db5a6204 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.239701 Aug 29 21:40:05.057782 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 345/692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:04 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:05.214213 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f075923-c09f-445a-89e5-b87916cca950"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:05.217337 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:05.224458 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.225171 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.225792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.227123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.227728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.228291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.410540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:05.411551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:05.421407 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.422050 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.422557 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.423298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.423886 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.424405 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.629732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:05.641815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:05.644499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:05.645796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-62a4f5b1-cadc-4e9d-824b-e532785e34c4 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.240904 Aug 29 21:40:05.646553 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 346/693] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:05 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:06.085185 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:06.086413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:06.093615 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:06.094210 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:06.095812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.096908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:06.097576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:06.098595 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.257908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:06.266840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e0b42025-5144-47d5-870a-c6c54388b5bc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.185587 Aug 29 21:40:06.267499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 347/694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:06 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:06.669214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:06.669977 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:06.677331 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:06.678199 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:06.678962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.680383 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:06.680874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:06.681305 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.842239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:06.850649 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:06.852129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:06.853342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8e40d203-dfa2-4eb5-96b4-314cd752f57d tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.188231 Aug 29 21:40:06.854160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 348/695] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:06 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:07.290160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:07.290981 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:07.298423 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.299284 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.299792 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:07.300573 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.301119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.301606 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:07.458541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:07.467094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-76ecd5a5-7386-45bd-b1d0-caeeb8ac3bd3 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.181788 Aug 29 21:40:07.467834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 349/696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:07 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:07.878290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:07.878901 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:07.885369 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.885981 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.886415 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:07.887304 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.887759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.888626 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:08.057652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:08.067023 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:08.068696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:08.070711 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d2823af7-7ac6-4d1f-b465-b50f0841f3a3 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.195729 Aug 29 21:40:08.071984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 350/697] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:07 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:08.492619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:08.493374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:08.501242 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:08.501739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:08.502178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:08.503062 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:08.503546 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:08.503974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:08.668426 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:08.680657 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1afdbc2d-dcc9-4ad1-ab1e-075c865c6ec0 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.192273 Aug 29 21:40:08.681386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 351/698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:08 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:09.097485 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:09.098910 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:09.106245 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:09.106789 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:09.107258 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:09.108024 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:09.108540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:09.109010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:09.274186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:09.282657 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:09.284097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:09.285291 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-50b470ef-8367-4440-a077-8ec41f380dad tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.192796 Aug 29 21:40:09.285859 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 352/699] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:09 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:09.707163 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:09.708235 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:09.720575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:09.721396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:09.721525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:09.722232 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:09.722673 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:09.723103 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:09.946283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:09.955490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dac6c3ec-2166-433f-9a77-3e390102bf45 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.251973 Aug 29 21:40:09.960624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 353/700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:09 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:10.271263 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:10.311774 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:10.312565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:10.314826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:10.315677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:10.323298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.324208 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.324871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.325799 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.326360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.326789 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.329914 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:10.486822 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:10.498611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:10.500202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:10.501480 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-91fe61ef-64bc-45d9-96d7-a278f49e514e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.194072 Aug 29 21:40:10.502307 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 354/701] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:10 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:10.979880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:10.980617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:10.987078 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.987577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.988104 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.988783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.989244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.991020 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.125787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:11.133432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e107d12f-e661-48c7-9130-550c5dd4a9c1 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.157866 Aug 29 21:40:11.134003 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 355/702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:10 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:11.527353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:11.528243 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:11.536772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.537977 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.539274 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.540792 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.541897 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.542609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.629606 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:11.657492 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1c7c6dd8-8001-4c27-b746-bf520e332aaa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.447749 Aug 29 21:40:11.658227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 348/703] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:40:05 2022] POST /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments => generated 194 bytes in 6450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:11.828436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:11.837279 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:11.838735 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:11.839896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9c8df59e-1542-44dd-ae3a-a66ce3ca66bd tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.318162 Aug 29 21:40:11.840677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 356/704] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:11 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:12.156042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:12.156799 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:12.170188 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.170702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.171152 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.171871 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.172331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.172883 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.225226 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-af1c8221-606a-4563-a15e-f7a55a84acef req-498ca99e-8735-4972-aed8-f42c96d78cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33216d14-c1ca-4867-86c5-e017493c9da2", "tag": "12f4c8c9-4564-4ce5-97c5-15f8cb53f7fe"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:12.235279 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-af1c8221-606a-4563-a15e-f7a55a84acef req-498ca99e-8735-4972-aed8-f42c96d78cf7 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.235757 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-af1c8221-606a-4563-a15e-f7a55a84acef req-498ca99e-8735-4972-aed8-f42c96d78cf7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.236186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-af1c8221-606a-4563-a15e-f7a55a84acef req-498ca99e-8735-4972-aed8-f42c96d78cf7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.248815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-af1c8221-606a-4563-a15e-f7a55a84acef req-498ca99e-8735-4972-aed8-f42c96d78cf7 service nova] Creating event network-changed:12f4c8c9-4564-4ce5-97c5-15f8cb53f7fe for instance 33216d14-c1ca-4867-86c5-e017493c9da2 on hv-cinder-85426 Aug 29 21:40:12.253911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-af1c8221-606a-4563-a15e-f7a55a84acef req-498ca99e-8735-4972-aed8-f42c96d78cf7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093082 Aug 29 21:40:12.254636 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 357/705] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:12.338039 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:12.346253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-40d80f30-b327-4e40-9810-3271081c5deb tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.194826 Aug 29 21:40:12.346841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 349/706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:12 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:12.868565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:12.870477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:12.877827 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.878288 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.878736 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.879482 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:12.879936 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:12.880364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:13.056714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:13.070834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:13.073267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:13.075198 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1a240271-176d-4258-994d-75a41d109643 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.214402 Aug 29 21:40:13.076698 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 358/707] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:12 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:13.372475 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:13.373836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:13.383661 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:13.384461 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:13.385228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:13.386376 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:13.387268 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:13.387984 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:13.661275 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:13.672215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-14427b16-e40e-46b1-9a40-6a43d91e0113 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.306991 Aug 29 21:40:13.673140 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 350/708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:13 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:14.111433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:14.112046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:14.119769 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.120283 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.120889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.121611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.122073 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.122504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.275480 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:14.284744 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:14.286385 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:14.287700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-988c9357-98e4-4a4b-acd0-b1a0705cd6ed tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.180650 Aug 29 21:40:14.288865 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 359/709] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:14 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:14.702264 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:14.703099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:14.711529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.712041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.712489 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.713261 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.713726 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.714156 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.979658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:15.009239 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ae6fdd7d-3cbc-4a9b-8903-a642f096c5db tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.316093 Aug 29 21:40:15.010521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 351/710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:14 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:15.314870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:15.315530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:15.322219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:15.322887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:15.323570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:15.324281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:15.324861 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:15.325318 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:15.485156 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:15.493563 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:15.495274 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:15.496507 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6884cd61-d1bc-4f0f-8df1-ea0c6d7c7f9e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.186353 Aug 29 21:40:15.497112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 360/711] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:15 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:16.044500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:16.045378 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:16.052337 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.052883 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.053495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.054804 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.055296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.055728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.196089 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:16.204420 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8fa8b6ac-81e4-4caf-b395-bae0ac1df5c2 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.164166 Aug 29 21:40:16.205104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 352/712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:16 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:16.524242 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:16.525200 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:16.536454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.536998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.537437 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.538995 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.539764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.540235 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.710783 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:16.723189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:16.725347 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:16.727488 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-4c4cc691-92a0-425b-b1ba-18caaefed91b tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.211141 Aug 29 21:40:16.728311 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 361/713] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:16 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:16.751737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-7d02779e-4f36-4abb-8a7a-3b4f6138f3df req-bd7affdc-8b4f-465c-8325-ab29e9ad3dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11491cff-58f2-4d90-ae11-471c65c47bcb", "name": "network-vif-plugged", "status": "completed", "tag": "d22eeab8-4235-4014-83a9-d0d8e059e752"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:16.763340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-7d02779e-4f36-4abb-8a7a-3b4f6138f3df req-bd7affdc-8b4f-465c-8325-ab29e9ad3dd8 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.763863 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-7d02779e-4f36-4abb-8a7a-3b4f6138f3df req-bd7affdc-8b4f-465c-8325-ab29e9ad3dd8 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.764312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-7d02779e-4f36-4abb-8a7a-3b4f6138f3df req-bd7affdc-8b4f-465c-8325-ab29e9ad3dd8 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.779465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-7d02779e-4f36-4abb-8a7a-3b4f6138f3df req-bd7affdc-8b4f-465c-8325-ab29e9ad3dd8 service nova] Creating event network-vif-plugged:d22eeab8-4235-4014-83a9-d0d8e059e752 for instance 11491cff-58f2-4d90-ae11-471c65c47bcb on hv-cinder-85426 Aug 29 21:40:16.785775 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-7d02779e-4f36-4abb-8a7a-3b4f6138f3df req-bd7affdc-8b4f-465c-8325-ab29e9ad3dd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037761 Aug 29 21:40:16.786730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 353/714] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:17.229614 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:17.230620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:17.239684 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.240472 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.241243 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.242416 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.243164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.243874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.430149 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.440482 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ec5de887-9a5b-4667-8f61-51ffb212bcfa tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.217952 Aug 29 21:40:17.441184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 362/715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:17 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:17.755683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:17.756491 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:17.762873 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.763613 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.764045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.764783 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.765290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.765687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.933224 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.946605 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.948111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.949349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9026cf7a-3599-40be-883c-02b006c7a656 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.198743 Aug 29 21:40:17.949918 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 354/716] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:17 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:18.468611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:18.472010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:18.481981 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.483312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.483627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.484861 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.485858 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.486624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.730573 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:18.743910 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-91a4987c-faaf-4822-b45e-301f46034d6a tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.279321 Aug 29 21:40:18.744971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 363/717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:18 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:18.810118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-babbf14c-e03b-4d00-848f-bb62fb961694 req-58d9aa3e-7cbf-483f-b0f0-37793849244e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33216d14-c1ca-4867-86c5-e017493c9da2", "name": "network-vif-plugged", "status": "completed", "tag": "12f4c8c9-4564-4ce5-97c5-15f8cb53f7fe"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:18.819429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-babbf14c-e03b-4d00-848f-bb62fb961694 req-58d9aa3e-7cbf-483f-b0f0-37793849244e service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.819887 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-babbf14c-e03b-4d00-848f-bb62fb961694 req-58d9aa3e-7cbf-483f-b0f0-37793849244e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.820323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-babbf14c-e03b-4d00-848f-bb62fb961694 req-58d9aa3e-7cbf-483f-b0f0-37793849244e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.841818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-babbf14c-e03b-4d00-848f-bb62fb961694 req-58d9aa3e-7cbf-483f-b0f0-37793849244e service nova] Creating event network-vif-plugged:12f4c8c9-4564-4ce5-97c5-15f8cb53f7fe for instance 33216d14-c1ca-4867-86c5-e017493c9da2 on hv-cinder-85426 Aug 29 21:40:18.849351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-babbf14c-e03b-4d00-848f-bb62fb961694 req-58d9aa3e-7cbf-483f-b0f0-37793849244e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043680 Aug 29 21:40:18.851194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 355/718] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:18.981803 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:18.982644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:18.990146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.990646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.991128 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.991865 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.992424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.992878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:19.153342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:19.167416 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:19.168835 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:19.170191 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6942d23f-2826-4a87-abd3-8859fd0af879 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1732 microversion: 2.20 time: 0.192599 Aug 29 21:40:19.170749 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 364/719] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:18 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:19.772236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:19.772962 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:19.779638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:19.780054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:19.780484 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:19.781209 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:19.781667 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:19.782098 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:19.926118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:19.934750 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ab204d84-8209-4c8d-9def-044b5f8b7945 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.166945 Aug 29 21:40:19.935341 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 356/720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:19 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:20.201863 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:20.202446 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:20.209239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.210213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.210675 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.211387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.211832 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.212254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.267280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:20.267809 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:20.274269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.274757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.275426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.275426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.277111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.277111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.304169 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-714e09ed-934a-4262-806b-71fc5c328064 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/ips" status: 200 len: 149 microversion: 2.1 time: 0.041141 Aug 29 21:40:20.311682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 357/721] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:40:20 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:20.373623 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:20.382460 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:20.384349 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:20.388908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5e6a8f8d-aadb-43ea-a23d-56d746dd5ad0 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1719 microversion: 2.20 time: 0.187861 Aug 29 21:40:20.388908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 365/722] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:20 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1719 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:20.449225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:20.451362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:20.457562 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.457970 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.458398 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.459095 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.459548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.460492 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.497496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-53768c91-c835-49f4-8428-0fd0a7626457 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052091 Aug 29 21:40:20.498220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 358/723] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:20 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:20.515979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:20.516648 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:20.519289 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:20.526073 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.526641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.527112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.527834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.528296 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.528760 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.563695 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3c331aab-7892-4a94-b60b-7b0ff0e039fa tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/9f075923-c09f-445a-89e5-b87916cca950" status: 200 len: 194 microversion: 2.1 time: 0.054680 Aug 29 21:40:20.564309 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 366/724] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 29 21:40:20 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/9f075923-c09f-445a-89e5-b87916cca950 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:20.957886 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:20.958601 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:20.966217 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.966797 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.967321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.968104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.968642 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.969827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.109309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:21.117931 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4bf88f19-ff95-4f80-91bc-3797f94d550d tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1313 microversion: 2.1 time: 0.166357 Aug 29 21:40:21.118466 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 359/725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:20 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:21.775319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "758ee314-6a89-4b65-96bf-a4be47332c95"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:21.777991 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:21.786206 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.787110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.788516 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.789839 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.790679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.791477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.994570 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f171909-209e-43ad-a0f6-15eebb5e8b8f"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:21.996915 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:22.006834 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.007338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.008048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.009077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.009592 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.010434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.066642 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cc4a4a5b-e350-44b0-988a-1e3b683965a9 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "POST /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295511 Aug 29 21:40:22.067570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 367/726] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:40:21 2022] POST /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:22.145153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:22.146050 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:22.154923 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.155442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.155915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.157059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.157722 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.158180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.309246 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4e46c496-84f8-4849-a0b3-7ec97ffc7b44 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "POST /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318311 Aug 29 21:40:22.310279 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 360/727] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:40:21 2022] POST /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:22.319557 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:22.327729 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c47d2f88-8e91-4eb4-a009-86f42a0b2f52 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1498 microversion: 2.1 time: 0.187493 Aug 29 21:40:22.328324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 368/728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:22 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:22.895918 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:22.896559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:22.903558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.904039 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.904473 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.905196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.905647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.906062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.932907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:40:23.012289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e472b5fb-0dfa-47d4-abb4-157bfeb4558f tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 204 len: 0 microversion: 2.1 time: 0.120810 Aug 29 21:40:23.013369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 361/729] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:22 2022] DELETE /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:23.022010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:23.022656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:23.030359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:23.030902 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:23.031344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:23.032049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:23.032501 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:23.032968 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:23.182611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:23.190457 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8b766c06-f96d-4c6e-af2b-63f0850144ce tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1504 microversion: 2.1 time: 0.172435 Aug 29 21:40:23.191374 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 369/730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:23 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:24.212311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:24.213128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:24.220445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.220981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.221414 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.222111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.222559 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.222974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.406338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:24.415062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2b66a86c-e7f9-400b-893b-3eae1c58b2cc tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1504 microversion: 2.1 time: 0.207405 Aug 29 21:40:24.415649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 362/731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:24 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:24.971469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-736adf6e-3367-4f69-a38f-4dd2f80dd20a req-28a972a7-aaae-47d6-b3da-c0de3346870e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33216d14-c1ca-4867-86c5-e017493c9da2", "name": "network-vif-deleted", "tag": "12f4c8c9-4564-4ce5-97c5-15f8cb53f7fe"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:24.984186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-736adf6e-3367-4f69-a38f-4dd2f80dd20a req-28a972a7-aaae-47d6-b3da-c0de3346870e service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.984628 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-736adf6e-3367-4f69-a38f-4dd2f80dd20a req-28a972a7-aaae-47d6-b3da-c0de3346870e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.985041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-736adf6e-3367-4f69-a38f-4dd2f80dd20a req-28a972a7-aaae-47d6-b3da-c0de3346870e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.989121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:24.998622 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-736adf6e-3367-4f69-a38f-4dd2f80dd20a req-28a972a7-aaae-47d6-b3da-c0de3346870e service nova] Creating event network-vif-deleted:12f4c8c9-4564-4ce5-97c5-15f8cb53f7fe for instance 33216d14-c1ca-4867-86c5-e017493c9da2 on hv-cinder-85426 Aug 29 21:40:25.004318 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-736adf6e-3367-4f69-a38f-4dd2f80dd20a req-28a972a7-aaae-47d6-b3da-c0de3346870e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036284 Aug 29 21:40:25.005116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 370/732] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:25.440123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:25.440885 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:25.448671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.449176 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.449610 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.450322 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.450805 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.451231 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.474465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:25.489904 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.490385 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.491479 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.491822 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lazy-loading 'fault' on Instance uuid 33216d14-c1ca-4867-86c5-e017493c9da2 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:25.543311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22dd55b03a44014ba9e52ab79164eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe1d306716f49be9c1171a3b83d68f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:25.555578 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b385a5d3-3304-4f60-8753-aacb092d342e tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 200 len: 1303 microversion: 2.1 time: 0.119043 Aug 29 21:40:25.561914 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 363/733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:25 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:26.585542 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:26.586253 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] [instance: 33216d14-c1ca-4867-86c5-e017493c9da2] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:26.594070 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:26.595385 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:26.595385 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:26.597795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:26.597795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:26.597795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:26.613764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] HTTP exception thrown: Instance 33216d14-c1ca-4867-86c5-e017493c9da2 could not be found. Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Request method failure captured: Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 HTTP/1.1 Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTIc1Z4iSjb3gBBfYzmMUb1l-hr4vtJAquNjhJU3JCHSWZwREjcyb4mZU3dRii7SEwzCX-X1kG8fD4AEKnx71wt24jODq4ngVObnqKBJ8y_X5ej3jdcF9h80hDBYhYLpzCbPVBV4rTn8x76nBTmKSR_LJJJaRXCqgX2t2mXH4AXA3iU Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: cfe1d306716f49be9c1171a3b83d68f3 Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-VolumesActionsTest-806010808 Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:26.614105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cfe1d306716f49be9c1171a3b83d68f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfe1d306716f49be9c1171a3b83d68f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfe1d306716f49be9c1171a3b83d68f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cfe1d306716f49be9c1171a3b83d68f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-VolumesActionsTest-806010808 Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: cfe1d306716f49be9c1171a3b83d68f3 Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-VolumesActionsTest-806010808 Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-VolumesActionsTest-806010808-project Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: d22dd55b03a44014ba9e52ab79164eeb Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-VolumesActionsTest-806010808-project Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 33216d14-c1ca-4867-86c5-e017493c9da2 could not be found. Aug 29 21:40:26.615870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '33216d14-c1ca-4867-86c5-e017493c9da2'} Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33216d14-c1ca-4867-86c5-e017493c9da2 could not be found. Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:26.618056 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33216d14-c1ca-4867-86c5-e017493c9da2 could not be found. Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33216d14-c1ca-4867-86c5-e017493c9da2 could not be found. Aug 29 21:40:26.620892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:26.622142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] Returning 404 to user: Instance 33216d14-c1ca-4867-86c5-e017493c9da2 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:26.622142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1a39219a-4876-4ce5-a759-cce183cfe406 tempest-VolumesActionsTest-806010808 tempest-VolumesActionsTest-806010808-project] 10.222.0.20 "GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2" status: 404 len: 111 microversion: 2.1 time: 0.035163 Aug 29 21:40:26.622142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 371/734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:26 2022] GET /compute/v2.1/servers/33216d14-c1ca-4867-86c5-e017493c9da2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:32.136351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:32.139238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:32.151875 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:32.153003 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:32.153694 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:32.154716 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:32.155594 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:32.156258 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:32.359609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lazy-loading 'services' on Instance uuid 90cf2d9d-c660-4fb2-a97d-b14d667481ad {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:32.539507 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3cf8dc39-1900-403d-a27a-b1f2c0cb32b3 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments/758ee314-6a89-4b65-96bf-a4be47332c95" status: 202 len: 0 microversion: 2.1 time: 0.410685 Aug 29 21:40:32.547318 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 364/735] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:40:32 2022] DELETE /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments/758ee314-6a89-4b65-96bf-a4be47332c95 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:40:32.558978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:32.563521 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:32.580814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:32.583266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:32.583954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:32.585218 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:32.586024 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:32.586515 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:32.649585 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b04c992c-fac0-4da1-a751-e51674db248a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101139 Aug 29 21:40:32.651297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 372/736] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:32 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:33.667615 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:33.670818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:33.676106 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:33.679372 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:33.680067 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:33.680498 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:33.681368 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:33.681676 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:33.682093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:33.721909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3e4ebb48-4c7e-4592-be3f-062daa302387 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061187 Aug 29 21:40:33.722892 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 365/737] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:33 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:34.734835 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:34.737005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:34.744478 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:34.745001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:34.745432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:34.746125 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:34.746750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:34.747454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:34.806920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-17a5fa45-0920-4aaf-9fce-6bbd43a00d09 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075939 Aug 29 21:40:34.813545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 373/738] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:34 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:35.824773 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:35.828865 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:35.842045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:35.843108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:35.843686 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:35.844902 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:35.845744 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:35.846591 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:35.907498 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2d7ce697-5848-453d-aa9c-d11ae3becbbc tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086644 Aug 29 21:40:35.908829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 366/739] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:35 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:36.925895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:36.929937 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:36.938271 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:36.939501 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:36.940046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:36.940895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:36.941939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:36.942891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:36.997060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1e45bd00-d5e3-4c7d-86d0-d7581e55cca4 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076921 Aug 29 21:40:36.998393 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 374/740] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:36 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:38.019979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:38.023473 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:38.034137 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.035037 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.035789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.037714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.038428 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.039225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.094239 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a7f41a39-ffae-4a48-beff-6b94400b304a tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086791 Aug 29 21:40:38.095518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 367/741] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:38 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:38.859677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:38.864833 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:38.879431 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.880290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.881752 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.883194 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.884192 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.885183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.953464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-23d0b195-0059-4bf9-8abc-d98b1ebcd864 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.098167 Aug 29 21:40:38.954396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 375/742] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:38 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments => generated 371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:39.107385 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:39.108203 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:39.111800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:39.116059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:39.121502 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.122232 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.122444 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.123172 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.123639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.125140 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.126180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.127126 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.128313 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.129188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.129876 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.130329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.189342 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c91a10a8-2901-4818-942c-3ba72fd9901f tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/9f075923-c09f-445a-89e5-b87916cca950" status: 200 len: 194 microversion: 2.1 time: 0.105278 Aug 29 21:40:39.189962 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 368/743] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 29 21:40:39 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/9f075923-c09f-445a-89e5-b87916cca950 => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:39.207607 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:39.208406 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:39.210834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-048414c1-160f-4d1b-9b7d-61e3038d8ee0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105731 Aug 29 21:40:39.211421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 376/744] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:39 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:39.235348 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.237699 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.238943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.240502 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.243178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.244198 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.402178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lazy-loading 'services' on Instance uuid 7171d45d-5cb8-4d4f-977b-ee2671c5f571 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:39.564823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-881e9839-6809-4893-b2f1-dde4973684e7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/9f075923-c09f-445a-89e5-b87916cca950" status: 202 len: 0 microversion: 2.1 time: 0.361672 Aug 29 21:40:39.565314 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 369/745] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:40:39 2022] DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/9f075923-c09f-445a-89e5-b87916cca950 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:40:40.229837 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:40.232233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:40.243518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.244507 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.245353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.246068 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.246700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.247116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.300992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-15bb7731-ad52-4fa6-8765-86a22d8c671d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077833 Aug 29 21:40:40.311388 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 377/746] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:40 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:40:40.410239 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:40.411165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:40.420451 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.421349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.422076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.423600 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.424399 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.425595 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.469548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:40:40.614927 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-825fc736-4fe1-4386-bed1-7c0f085e8377 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 204 len: 0 microversion: 2.1 time: 0.211669 Aug 29 21:40:40.618048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 370/747] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:40 2022] DELETE /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:40.630641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:40.632511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:40.664772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.665886 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.666750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.668710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:40.671135 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:40.673323 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:40.943992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:40.957928 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-931be891-8a02-469d-9e13-2e0b5c387f0f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1680 microversion: 2.1 time: 0.334625 Aug 29 21:40:40.959181 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 378/748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:40 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:41.949463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:41.949463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:41.956830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:41.957322 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:41.957752 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:41.958454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:41.958926 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:41.959441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:41.996366 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:41.997128 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:42.003994 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.004796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.005241 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.006544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.007375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.008214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.021330 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-36003d40-d6a4-4b82-8e7e-28a146eaf4db tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/3f171909-209e-43ad-a0f6-15eebb5e8b8f" status: 200 len: 194 microversion: 2.1 time: 0.081686 Aug 29 21:40:42.023792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 371/749] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 29 21:40:41 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/3f171909-209e-43ad-a0f6-15eebb5e8b8f => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:42.040723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:42.040723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:42.051232 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.051984 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.052620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.054427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.055601 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.056163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.289846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lazy-loading 'services' on Instance uuid 7171d45d-5cb8-4d4f-977b-ee2671c5f571 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:42.328041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:42.345919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-85396164-65e2-45de-bb2e-d24fa63d23ef tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1680 microversion: 2.1 time: 0.356910 Aug 29 21:40:42.347272 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 379/750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:41 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1680 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:42.438731 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-985781d7-7870-43ed-8130-19e2b219dc70 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/3f171909-209e-43ad-a0f6-15eebb5e8b8f" status: 202 len: 0 microversion: 2.1 time: 0.406756 Aug 29 21:40:42.440231 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 372/751] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:40:42 2022] DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments/3f171909-209e-43ad-a0f6-15eebb5e8b8f => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:40:43.398197 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:43.400361 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:43.414831 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.416189 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.417446 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.419377 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.420645 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.422673 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.797704 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:43.802609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:43.814849 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.816238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.817376 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.819516 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.820696 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.821780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.836344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:43.864046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-43744b9c-db87-4734-9506-e8ea5723e118 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1680 microversion: 2.1 time: 0.481328 Aug 29 21:40:43.876812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 380/752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:43 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1680 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:43.883463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ea4fec42-d6d0-4645-8b45-809c62c659b7 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093455 Aug 29 21:40:43.885650 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 373/753] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:43 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:40:44.145636 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:44.154714 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:44.174152 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.174946 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.175965 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.176869 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.177638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.178936 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.259424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-608c447a-54bf-4a84-a470-d9b3fb0c42df tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120012 Aug 29 21:40:44.261948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 381/754] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:44 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:40:44.374395 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:44.375144 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:44.389046 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.389812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.390457 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.391528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.392482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.393480 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.446455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:40:44.550992 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:44.679895 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c3ff037e-a140-4819-944f-1c3311ab4137 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 204 len: 0 microversion: 2.1 time: 0.307474 Aug 29 21:40:44.685068 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 374/755] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:44 2022] DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:44.698576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:44.700243 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:44.716948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.717755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.718375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.719443 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.720229 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.720987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.901971 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:44.903412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:44.911846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.913191 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.913872 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.915107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.916056 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.916933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:45.172085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:45.177060 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:45.189744 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-88ac84a0-df26-46d3-a05f-861812b0d0bd tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1674 microversion: 2.1 time: 0.497743 Aug 29 21:40:45.191558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 382/756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:44 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1674 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:45.201145 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-8950c246-6f7c-4f53-8adf-0b7ee6e4c1c8 req-334bad6e-41a6-4e8a-be5e-716dd5da5b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cf2d9d-c660-4fb2-a97d-b14d667481ad", "name": "network-vif-deleted", "tag": "b0874f96-e644-4660-bee2-6988edf50b89"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:45.206713 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3f7ef986-f810-4dc9-9c33-2be2e1b0030b tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1613 microversion: 2.1 time: 0.307432 Aug 29 21:40:45.210194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 375/757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:44 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1613 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:45.219800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-8950c246-6f7c-4f53-8adf-0b7ee6e4c1c8 req-334bad6e-41a6-4e8a-be5e-716dd5da5b37 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:45.220918 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-8950c246-6f7c-4f53-8adf-0b7ee6e4c1c8 req-334bad6e-41a6-4e8a-be5e-716dd5da5b37 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:45.221701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-8950c246-6f7c-4f53-8adf-0b7ee6e4c1c8 req-334bad6e-41a6-4e8a-be5e-716dd5da5b37 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:45.244244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-8950c246-6f7c-4f53-8adf-0b7ee6e4c1c8 req-334bad6e-41a6-4e8a-be5e-716dd5da5b37 service nova] Creating event network-vif-deleted:b0874f96-e644-4660-bee2-6988edf50b89 for instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad on hv-cinder-85426 Aug 29 21:40:45.254432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-8950c246-6f7c-4f53-8adf-0b7ee6e4c1c8 req-334bad6e-41a6-4e8a-be5e-716dd5da5b37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060673 Aug 29 21:40:45.255669 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 383/758] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:46.231248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:46.232838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:46.260680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:46.261186 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:46.262796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:46.264425 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:46.265543 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:46.267245 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:46.268389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:46.269311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:46.272481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:46.273427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:46.274076 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:46.275026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:46.275674 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:46.276289 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:46.530592 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:46.543324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f16926dd-5e47-4022-aa57-b12d20c01ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1613 microversion: 2.1 time: 0.292846 Aug 29 21:40:46.549042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 384/759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:46 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1613 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:46.685466 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:46.726947 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-23d7081c-eaa5-481d-afca-7f923c0c681e tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1674 microversion: 2.1 time: 0.484225 Aug 29 21:40:46.751870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 376/760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:46 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1674 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:47.578838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:47.580236 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:47.591417 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.592505 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.593446 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:47.594766 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.595678 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.596616 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:47.662278 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.663633 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.664718 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:47.665829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lazy-loading 'fault' on Instance uuid 90cf2d9d-c660-4fb2-a97d-b14d667481ad {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:47.769912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b272427c6444b49293e5046c686ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220f1dfa6a74754bd08f925c85847b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:47.778335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:47.779405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:47.783669 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a4b499fb-43b1-4d61-97ea-e9796f5f52d0 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 200 len: 1331 microversion: 2.1 time: 0.211881 Aug 29 21:40:47.802981 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 385/761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:47 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 1331 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:47.803881 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.807371 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.808822 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:47.809043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.809589 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.810294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:48.317681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:48.335507 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3bb4d93f-6c32-40ee-a5ad-0a50c888e800 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1674 microversion: 2.1 time: 0.566426 Aug 29 21:40:48.337648 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 377/762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:47 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1674 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:48.824193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:48.827877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:48.840827 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:48.842064 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:48.842646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:48.850078 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:48.850078 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:48.850078 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:48.883635 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad HTTP/1.1 Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:48.886979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:48.890175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '90cf2d9d-c660-4fb2-a97d-b14d667481ad'} Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:48.891805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:48.894780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:48.898581 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:48.898581 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5ec2f47f-823c-497c-a900-bd5013f77e4c tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 404 len: 111 microversion: 2.1 time: 0.080867 Aug 29 21:40:48.898581 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 386/763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:48 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:48.916772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-388877d4-1940-437b-822d-d5f1007fcc43 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '.version_select at 0x7f5402a71c10>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:48.956029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-388877d4-1940-437b-822d-d5f1007fcc43 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066723818" status: 202 len: 0 microversion: 2.1 time: 0.047182 Aug 29 21:40:48.959508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 378/764] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 21:40:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066723818 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:40:49.251895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-6b8ec122-2c09-4b53-a394-53b6cdc1d9c0 req-af5f97db-e3ec-4c02-b183-3a7ff18f15e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7171d45d-5cb8-4d4f-977b-ee2671c5f571", "name": "network-vif-deleted", "tag": "aa8ad2bc-9646-412b-97d9-d20f139892e1"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:49.295648 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-6b8ec122-2c09-4b53-a394-53b6cdc1d9c0 req-af5f97db-e3ec-4c02-b183-3a7ff18f15e4 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:49.296421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-6b8ec122-2c09-4b53-a394-53b6cdc1d9c0 req-af5f97db-e3ec-4c02-b183-3a7ff18f15e4 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:49.305212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-6b8ec122-2c09-4b53-a394-53b6cdc1d9c0 req-af5f97db-e3ec-4c02-b183-3a7ff18f15e4 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:49.346740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-6b8ec122-2c09-4b53-a394-53b6cdc1d9c0 req-af5f97db-e3ec-4c02-b183-3a7ff18f15e4 service nova] Creating event network-vif-deleted:aa8ad2bc-9646-412b-97d9-d20f139892e1 for instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 on hv-cinder-85426 Aug 29 21:40:49.360660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:49.361783 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:49.370337 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-6b8ec122-2c09-4b53-a394-53b6cdc1d9c0 req-af5f97db-e3ec-4c02-b183-3a7ff18f15e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133132 Aug 29 21:40:49.371921 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:49.373130 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:49.374392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:49.379712 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 387/765] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:49.380365 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:49.381839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:49.384220 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:49.610751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d97b196f44ec985db30f86d4ad3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9928c37b2b46f5abd0ac1ba1c3ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:49.643312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9cda1b41-97fc-4ef6-9ad9-8bb4ff0d5f78 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 200 len: 1322 microversion: 2.1 time: 0.286786 Aug 29 21:40:49.649355 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 379/766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:49 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:50.696164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:50.697254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:50.700526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=46 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:50.705492 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:50.705492 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:50.705492 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:50.706472 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:50.707326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:50.707770 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:50.725018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] HTTP exception thrown: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Request method failure captured: Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 HTTP/1.1 Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDgJlt1hIdKWzVSNuJ7Z2XsO7-YQzlkvopv0cHPX_mcqhuj0CTbxSAOW5A-185DPw0KeQycyOLQjHzS9WKPsu5xkX7A5Zw82if5fc07n5xMrrRLv6s8dG5g_oQgqX0KXEPBJOlw6fOKGEysXIN8t5cdgdGNPwsBs6ZpplhKt43VBl4 Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:50.726702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d9928c37b2b46f5abd0ac1ba1c3ca92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 6f0d97b196f44ec985db30f86d4ad3f4 Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:50.729090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '7171d45d-5cb8-4d4f-977b-ee2671c5f571'} Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:50.730640 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:50.732829 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:50.735132 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Returning 404 to user: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:50.735132 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b6f5cc57-39e5-4daf-8668-35a809d47b50 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 404 len: 111 microversion: 2.1 time: 0.037655 Aug 29 21:40:50.739978 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1d03b6a7-c577-47e7-8939-28e73952b955 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '.version_select at 0x7f54029c2550>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:50.746287 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 388/767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:50 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:50.785116 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1d03b6a7-c577-47e7-8939-28e73952b955 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105059503" status: 202 len: 0 microversion: 2.1 time: 0.050328 Aug 29 21:40:50.787756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 380/768] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 21:40:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105059503 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:40:51.733018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:51.734143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:51.752372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:51.753433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:51.754500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:51.756462 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:51.757404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:51.758247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:51.791879 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad HTTP/1.1 Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:51.795365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.798095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '90cf2d9d-c660-4fb2-a97d-b14d667481ad'} Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:51.799701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.802124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.806893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:51.806893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-143d30cc-4b66-4a02-84f8-271c2d308c73 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 404 len: 111 microversion: 2.1 time: 0.072990 Aug 29 21:40:51.806893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 389/769] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:51 2022] DELETE /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:51.809580 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:51.810527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: 90cf2d9d-c660-4fb2-a97d-b14d667481ad] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:51.819357 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:51.819713 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:51.820115 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:51.823803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:51.823803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:51.823803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:51.839780 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad HTTP/1.1 Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:40:51.841494 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.846718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '90cf2d9d-c660-4fb2-a97d-b14d667481ad'} Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:51.849815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. Aug 29 21:40:51.852789 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:51.854728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance 90cf2d9d-c660-4fb2-a97d-b14d667481ad could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:51.854728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-614f3747-96c3-4b39-aff5-cff788d6aeec tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad" status: 404 len: 111 microversion: 2.1 time: 0.037398 Aug 29 21:40:51.854728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 381/770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:51 2022] GET /compute/v2.1/servers/90cf2d9d-c660-4fb2-a97d-b14d667481ad => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:53.074957 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:53.075807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:53.083313 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.083936 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.084525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.085656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.086364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.086901 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.103160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 HTTP/1.1 Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:53.104750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.108072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'c3d22285-60c9-4602-aa73-9cfac08e8497'} Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:53.109686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.112033 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.114717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:53.114717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-eb7566ad-009e-48ad-a13b-cc1864872c1d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 404 len: 111 microversion: 2.1 time: 0.036106 Aug 29 21:40:53.114717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 390/771] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:53 2022] DELETE /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:53.123853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:53.125242 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: c3d22285-60c9-4602-aa73-9cfac08e8497] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:53.135556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.136327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.137065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.138444 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.139188 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.139868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.170226 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 HTTP/1.1 Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:40:53.172838 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.175535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'c3d22285-60c9-4602-aa73-9cfac08e8497'} Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:53.177879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. Aug 29 21:40:53.180455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.182363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance c3d22285-60c9-4602-aa73-9cfac08e8497 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:53.182363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-59d129ea-7a54-4af3-bc72-6ee17372a73e tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497" status: 404 len: 111 microversion: 2.1 time: 0.057294 Aug 29 21:40:53.182363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 382/772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:53 2022] GET /compute/v2.1/servers/c3d22285-60c9-4602-aa73-9cfac08e8497 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:53.188733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:53.189795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:53.199384 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.200081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.200850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.201750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.202845 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.203733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.223212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 HTTP/1.1 Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:53.226069 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.228710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'af818bf6-764a-4013-a8f8-44c66e76a0e1'} Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:53.230231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.232500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.235713 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:53.235713 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-fcb38d40-2589-47af-a094-ee11d9bef40d tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 404 len: 111 microversion: 2.1 time: 0.047371 Aug 29 21:40:53.235713 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 391/773] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:53 2022] DELETE /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:53.245055 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:53.246465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: af818bf6-764a-4013-a8f8-44c66e76a0e1] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:53.256856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.257673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.258398 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.259544 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.260313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.260966 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.284508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 HTTP/1.1 Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:40:53.286253 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.293107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'af818bf6-764a-4013-a8f8-44c66e76a0e1'} Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:53.293891 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. Aug 29 21:40:53.295099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:53.296280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance af818bf6-764a-4013-a8f8-44c66e76a0e1 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:53.296280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-08798226-20c9-4d20-94b8-30ec7475699f tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1" status: 404 len: 111 microversion: 2.1 time: 0.050569 Aug 29 21:40:53.296280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 383/774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:53 2022] GET /compute/v2.1/servers/af818bf6-764a-4013-a8f8-44c66e76a0e1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:54.317371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:54.318175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:54.328029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.328518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.328986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.329891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.330353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.330782 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.346573 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] HTTP exception thrown: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Request method failure captured: Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 HTTP/1.1 Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDgJlt1hIdKWzVSNuJ7Z2XsO7-YQzlkvopv0cHPX_mcqhuj0CTbxSAOW5A-185DPw0KeQycyOLQjHzS9WKPsu5xkX7A5Zw82if5fc07n5xMrrRLv6s8dG5g_oQgqX0KXEPBJOlw6fOKGEysXIN8t5cdgdGNPwsBs6ZpplhKt43VBl4 Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:54.348969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d9928c37b2b46f5abd0ac1ba1c3ca92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 6f0d97b196f44ec985db30f86d4ad3f4 Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.352138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '7171d45d-5cb8-4d4f-977b-ee2671c5f571'} Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:54.354566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.357487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.359699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Returning 404 to user: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:54.359699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0bdcf1aa-4fc8-4e85-a504-e8a0f996b637 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 404 len: 111 microversion: 2.1 time: 0.041221 Aug 29 21:40:54.359699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 392/775] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:54 2022] DELETE /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:54.362490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:54.363457 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 7171d45d-5cb8-4d4f-977b-ee2671c5f571] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:54.371788 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.373300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.373300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.374309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.374908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.375470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.393647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] HTTP exception thrown: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Request method failure captured: Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 HTTP/1.1 Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDgJlt1hIdKWzVSNuJ7Z2XsO7-YQzlkvopv0cHPX_mcqhuj0CTbxSAOW5A-185DPw0KeQycyOLQjHzS9WKPsu5xkX7A5Zw82if5fc07n5xMrrRLv6s8dG5g_oQgqX0KXEPBJOlw6fOKGEysXIN8t5cdgdGNPwsBs6ZpplhKt43VBl4 Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:40:54.396086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d9928c37b2b46f5abd0ac1ba1c3ca92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 6f0d97b196f44ec985db30f86d4ad3f4 Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.400894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '7171d45d-5cb8-4d4f-977b-ee2671c5f571'} Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:54.402102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. Aug 29 21:40:54.405163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.407301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Returning 404 to user: Instance 7171d45d-5cb8-4d4f-977b-ee2671c5f571 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:54.407301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-212094d2-2a94-40db-92b1-ac162c3f38b8 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571" status: 404 len: 111 microversion: 2.1 time: 0.039479 Aug 29 21:40:54.407301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 384/776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:54 2022] GET /compute/v2.1/servers/7171d45d-5cb8-4d4f-977b-ee2671c5f571 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:54.491998 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:54.493699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:54.501642 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.502307 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.502955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.504019 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.504676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.505351 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.513045 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=100 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:54.526593 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 HTTP/1.1 Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:54.529627 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.531116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'd7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57'} Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:54.531876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.533244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.537507 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:54.538665 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-90c5b9c7-5987-4fee-830f-129367852ea6 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 404 len: 111 microversion: 2.1 time: 0.051878 Aug 29 21:40:54.539444 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 393/777] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:54 2022] DELETE /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:54.548649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:54.549701 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] [instance: d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:54.571075 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.571075 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.571075 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.571075 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.571627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.571627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.587839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] HTTP exception thrown: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Request method failure captured: Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 HTTP/1.1 Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDZZE2FPASZhJQ6mhEx-OoHAMFQBVxpqoqRweevbAb_pGfcjK9ebe4vqg5Be-rqPM62T1Z8-LmfOr0uVq5pxrZwlJB_MlaRgq0eZydTawpMaYFHvjQPwryNpS69bsiwaa238-8mEcc3qSj9CyCZpA_eZgKNpW8CRlr-j36K6kBLznY Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:40:54.591199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5220f1dfa6a74754bd08f925c85847b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5220f1dfa6a74754bd08f925c85847b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 5220f1dfa6a74754bd08f925c85847b2 Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1487515603 Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 89b272427c6444b49293e5046c686ffc Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeNegativeTest-1487515603-project Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.593840 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'd7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57'} Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:54.595527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. Aug 29 21:40:54.599920 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:54.603485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] Returning 404 to user: Instance d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:54.603485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5d1cc55e-3d59-459f-9b20-2f7ccf46b719 tempest-AttachVolumeNegativeTest-1487515603 tempest-AttachVolumeNegativeTest-1487515603-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57" status: 404 len: 111 microversion: 2.1 time: 0.049078 Aug 29 21:40:54.603485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 385/778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:54 2022] GET /compute/v2.1/servers/d7e5fcd4-d76a-4ba5-bcad-9b90a32a2b57 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:55.609470 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:55.610541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:55.624129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:55.625674 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:55.626609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:55.627619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:55.629110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:55.630049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:55.652401 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] HTTP exception thrown: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Request method failure captured: Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d HTTP/1.1 Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDgJlt1hIdKWzVSNuJ7Z2XsO7-YQzlkvopv0cHPX_mcqhuj0CTbxSAOW5A-185DPw0KeQycyOLQjHzS9WKPsu5xkX7A5Zw82if5fc07n5xMrrRLv6s8dG5g_oQgqX0KXEPBJOlw6fOKGEysXIN8t5cdgdGNPwsBs6ZpplhKt43VBl4 Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:40:55.655202 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d9928c37b2b46f5abd0ac1ba1c3ca92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 6f0d97b196f44ec985db30f86d4ad3f4 Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.658030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '4c3846b1-ac29-4006-89ea-bcd7a6c82b2d'} Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:55.659656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.663094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.667142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Returning 404 to user: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:55.668806 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0725d608-413a-444d-996e-f3249d9c3819 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 404 len: 111 microversion: 2.1 time: 0.066057 Aug 29 21:40:55.670328 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 394/779] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:55 2022] DELETE /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:55.679052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:55.680358 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] [instance: 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:55.689605 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:55.690014 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:55.690664 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:55.691384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:55.692635 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:55.692635 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:55.721657 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] HTTP exception thrown: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Request method failure captured: Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d HTTP/1.1 Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDgJlt1hIdKWzVSNuJ7Z2XsO7-YQzlkvopv0cHPX_mcqhuj0CTbxSAOW5A-185DPw0KeQycyOLQjHzS9WKPsu5xkX7A5Zw82if5fc07n5xMrrRLv6s8dG5g_oQgqX0KXEPBJOlw6fOKGEysXIN8t5cdgdGNPwsBs6ZpplhKt43VBl4 Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:40:55.724791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d9928c37b2b46f5abd0ac1ba1c3ca92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d9928c37b2b46f5abd0ac1ba1c3ca92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 7d9928c37b2b46f5abd0ac1ba1c3ca92 Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595716388 Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 6f0d97b196f44ec985db30f86d4ad3f4 Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeTestJSON-595716388-project Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.727340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '4c3846b1-ac29-4006-89ea-bcd7a6c82b2d'} Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:55.729596 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. Aug 29 21:40:55.732786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:40:55.735637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] Returning 404 to user: Instance 4c3846b1-ac29-4006-89ea-bcd7a6c82b2d could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:55.735637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d58e00da-b971-40be-9e7d-304add834216 tempest-AttachVolumeTestJSON-595716388 tempest-AttachVolumeTestJSON-595716388-project] 10.222.0.20 "GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d" status: 404 len: 111 microversion: 2.1 time: 0.052849 Aug 29 21:40:55.735637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 386/780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:55 2022] GET /compute/v2.1/servers/4c3846b1-ac29-4006-89ea-bcd7a6c82b2d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:01.716463 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:01.718664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:01.730215 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:01.731508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:01.732456 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:01.734114 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:01.735232 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:01.736197 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:01.814053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7fcee231-3000-4ea0-b2be-1dca0b735d58 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.102707 Aug 29 21:41:01.827330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 395/781] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 21:41:01 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:01.953417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:01.953997 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:01.963010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:01.963477 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:01.963924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:01.964670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:01.965326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:01.965927 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:02.007194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:41:02.134221 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2375eb26-8153-4e2b-9897-74c16d335637 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 204 len: 0 microversion: 2.20 time: 0.188016 Aug 29 21:41:02.136745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 387/782] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 21:41:01 2022] DELETE /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:41:02.149042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:02.151213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:02.159352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:02.160263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:02.161068 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:02.163448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:02.164343 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:02.165294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:02.435698 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:02.464120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:02.466841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:02.469922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3b388406-c0bd-4286-ba09-608df56620e2 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.325463 Aug 29 21:41:02.471440 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 396/783] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:02 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:03.500131 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:03.507082 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:03.529706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.530898 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.531873 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.533301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.538092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.539335 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.909444 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:03.927738 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:03.929860 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:03.932119 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-fbdedb90-bcc6-47a2-aa0b-7f9ed8f4b9bf tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1725 microversion: 2.20 time: 0.439234 Aug 29 21:41:03.945210 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 388/784] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:03 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1725 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:04.958965 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:04.960057 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:04.979661 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:04.980411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:04.980900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:04.984333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:04.984333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:04.984333 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:05.175582 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:05.189290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:05.190841 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55a5c6359109440fbb66d985fafc24bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09369e28336d4f49a60ce03c3a3009ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:05.192107 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-744ff169-c250-434c-ad39-38b2e7092b75 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 200 len: 1657 microversion: 2.20 time: 0.240438 Aug 29 21:41:05.209836 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 397/785] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:04 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 1657 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:05.443121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-64dcdadd-0afd-4693-aa95-462e5c5fda0c req-51984fa4-0cb3-4cbc-b512-f7d9706ac0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11491cff-58f2-4d90-ae11-471c65c47bcb", "name": "network-vif-deleted", "tag": "d22eeab8-4235-4014-83a9-d0d8e059e752"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:05.457561 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:05.477286 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-64dcdadd-0afd-4693-aa95-462e5c5fda0c req-51984fa4-0cb3-4cbc-b512-f7d9706ac0b6 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:05.485744 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-64dcdadd-0afd-4693-aa95-462e5c5fda0c req-51984fa4-0cb3-4cbc-b512-f7d9706ac0b6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:05.488801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-64dcdadd-0afd-4693-aa95-462e5c5fda0c req-51984fa4-0cb3-4cbc-b512-f7d9706ac0b6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:05.541469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-64dcdadd-0afd-4693-aa95-462e5c5fda0c req-51984fa4-0cb3-4cbc-b512-f7d9706ac0b6 service nova] Creating event network-vif-deleted:d22eeab8-4235-4014-83a9-d0d8e059e752 for instance 11491cff-58f2-4d90-ae11-471c65c47bcb on hv-cinder-85426 Aug 29 21:41:05.550909 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-64dcdadd-0afd-4693-aa95-462e5c5fda0c req-51984fa4-0cb3-4cbc-b512-f7d9706ac0b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111923 Aug 29 21:41:05.551631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 389/786] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:06.238986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:06.241243 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:06.249818 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:06.251325 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:06.252436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:06.253795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:06.254715 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:06.256059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:06.279379 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] HTTP exception thrown: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Request method failure captured: Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb HTTP/1.1 Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDfOByAvK9vpU0vB1gZeiqtEwxuW3F3MCpJh-99oZHnm4l34899V6bWuRsqn2OAVZ7zKB26cSf2moHEhmTrUbNqv6hEktJ_NRt05rwbXnEp-PwF8Ou2qHSqHBiTZEjF2iHs8ltuqu6VuQnsD35GH2EsbhRILjT_HrxpPovqwpzzgcg Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:41:06.281239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09369e28336d4f49a60ce03c3a3009ac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 55a5c6359109440fbb66d985fafc24bf Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:06.282681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '11491cff-58f2-4d90-ae11-471c65c47bcb'} Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:06.283716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:06.291121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:06.292759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Returning 404 to user: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:06.292759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-fa09d9e1-da0f-4a6b-a9a8-752dcec4b83e tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 404 len: 111 microversion: 2.20 time: 0.049653 Aug 29 21:41:06.292759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 398/787] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:06 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:41:06.295605 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8dd035c9-e101-41c8-8e74-0ca6a4887a51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '.version_select at 0x7f5402a34670>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:06.322455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8dd035c9-e101-41c8-8e74-0ca6a4887a51 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448550884" status: 204 len: 0 microversion: 2.20 time: 0.031087 Aug 29 21:41:06.323333 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 390/788] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 21:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448550884 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:41:08.542519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:08.543598 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:08.556871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.556871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.556871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.558006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.559021 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.559817 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.586904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] HTTP exception thrown: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Request method failure captured: Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb HTTP/1.1 Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDfOByAvK9vpU0vB1gZeiqtEwxuW3F3MCpJh-99oZHnm4l34899V6bWuRsqn2OAVZ7zKB26cSf2moHEhmTrUbNqv6hEktJ_NRt05rwbXnEp-PwF8Ou2qHSqHBiTZEjF2iHs8ltuqu6VuQnsD35GH2EsbhRILjT_HrxpPovqwpzzgcg Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:41:08.590153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09369e28336d4f49a60ce03c3a3009ac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 55a5c6359109440fbb66d985fafc24bf Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.593133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '11491cff-58f2-4d90-ae11-471c65c47bcb'} Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:08.594352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.596105 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.600630 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Returning 404 to user: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:08.602918 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bf863b6b-0871-4b26-8af9-47ba16ef8ac7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 404 len: 111 microversion: 2.20 time: 0.066433 Aug 29 21:41:08.604611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 399/789] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 21:41:08 2022] DELETE /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:41:08.613833 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:08.614623 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: 11491cff-58f2-4d90-ae11-471c65c47bcb] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:08.623623 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.624131 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.624656 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.625932 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.626691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.627442 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.646341 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] HTTP exception thrown: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Request method failure captured: Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb HTTP/1.1 Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDfOByAvK9vpU0vB1gZeiqtEwxuW3F3MCpJh-99oZHnm4l34899V6bWuRsqn2OAVZ7zKB26cSf2moHEhmTrUbNqv6hEktJ_NRt05rwbXnEp-PwF8Ou2qHSqHBiTZEjF2iHs8ltuqu6VuQnsD35GH2EsbhRILjT_HrxpPovqwpzzgcg Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:41:08.648407 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09369e28336d4f49a60ce03c3a3009ac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 55a5c6359109440fbb66d985fafc24bf Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '11491cff-58f2-4d90-ae11-471c65c47bcb'} Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:08.657449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. Aug 29 21:41:08.658982 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:08.660163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Returning 404 to user: Instance 11491cff-58f2-4d90-ae11-471c65c47bcb could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:08.660163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4bcd6909-1fc1-4419-8ca8-1066349d8562 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb" status: 404 len: 111 microversion: 2.20 time: 0.041942 Aug 29 21:41:08.660163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 391/790] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:08 2022] GET /compute/v2.1/servers/11491cff-58f2-4d90-ae11-471c65c47bcb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:41:09.855778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:09.856552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:09.868011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.868885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.869701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.870895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.871692 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.872568 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.890451 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] HTTP exception thrown: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Request method failure captured: Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 HTTP/1.1 Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTDfOByAvK9vpU0vB1gZeiqtEwxuW3F3MCpJh-99oZHnm4l34899V6bWuRsqn2OAVZ7zKB26cSf2moHEhmTrUbNqv6hEktJ_NRt05rwbXnEp-PwF8Ou2qHSqHBiTZEjF2iHs8ltuqu6VuQnsD35GH2EsbhRILjT_HrxpPovqwpzzgcg Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:41:09.892601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09369e28336d4f49a60ce03c3a3009ac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 55a5c6359109440fbb66d985fafc24bf Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.895530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'f3f3dbb7-c3ca-46ab-9903-477493581b37'} Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:09.897049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.899511 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.904578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Returning 404 to user: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:09.904578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-08bd9c97-b8df-4d69-b728-df061ead71e7 tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 404 len: 111 microversion: 2.20 time: 0.043685 Aug 29 21:41:09.904578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 400/791] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 21:41:09 2022] DELETE /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:41:09.904980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:09.904980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] [instance: f3f3dbb7-c3ca-46ab-9903-477493581b37] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:09.911231 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.911725 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.912154 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.912869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.913330 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.913741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.937907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] HTTP exception thrown: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Request method failure captured: Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 HTTP/1.1 Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTDfOByAvK9vpU0vB1gZeiqtEwxuW3F3MCpJh-99oZHnm4l34899V6bWuRsqn2OAVZ7zKB26cSf2moHEhmTrUbNqv6hEktJ_NRt05rwbXnEp-PwF8Ou2qHSqHBiTZEjF2iHs8ltuqu6VuQnsD35GH2EsbhRILjT_HrxpPovqwpzzgcg Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:41:09.939681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09369e28336d4f49a60ce03c3a3009ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09369e28336d4f49a60ce03c3a3009ac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 09369e28336d4f49a60ce03c3a3009ac Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1505775152 Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: 55a5c6359109440fbb66d985fafc24bf Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1505775152-project Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.941267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'f3f3dbb7-c3ca-46ab-9903-477493581b37'} Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:09.942900 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. Aug 29 21:41:09.946101 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:09.948426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] Returning 404 to user: Instance f3f3dbb7-c3ca-46ab-9903-477493581b37 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:09.948426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-fbebd36e-d396-4b77-93be-8ed31be4095a tempest-AttachVolumeShelveTestJSON-1505775152 tempest-AttachVolumeShelveTestJSON-1505775152-project] 10.222.0.20 "GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37" status: 404 len: 111 microversion: 2.20 time: 0.042067 Aug 29 21:41:09.948426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 392/792] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:09 2022] GET /compute/v2.1/servers/f3f3dbb7-c3ca-46ab-9903-477493581b37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 21:41:14.764329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-382578468", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:14.913808 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] validate_networks() for None {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:41:16.206733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:41:16.207577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:41:16.210903 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:41:16.211782 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:41:16.212443 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:41:16.229976 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:16.230836 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:16.231614 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:16.233009 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:16.234093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:16.234871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:16.274699 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Getting quotas for project dbf312281cdc4ad4925d1815c3ac7881. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:41:16.284436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Getting quotas for user b8ab0d2a5e1b4b4ab4378bd89d2db123 and project dbf312281cdc4ad4925d1815c3ac7881. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:41:16.317229 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:41:16.323986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:41:16.440913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-464198dd-d3ec-4efd-a0fd-01143e9903ac tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.680828 Aug 29 21:41:16.453612 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 401/793] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:41:16.458802 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1c36ca6c-1b03-4c3e-a40d-9950efa17ca6 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:16.460293 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1c36ca6c-1b03-4c3e-a40d-9950efa17ca6 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:16.580500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-1c36ca6c-1b03-4c3e-a40d-9950efa17ca6 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:16.595209 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1c36ca6c-1b03-4c3e-a40d-9950efa17ca6 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1214 microversion: 2.1 time: 0.142478 Aug 29 21:41:16.595799 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 393/794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:16 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:17.639988 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:17.645360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:17.690327 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:17.691578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:17.692491 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:17.696219 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:17.701952 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:17.705667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:17.864387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:17.894246 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d647b7fd-5817-49ee-b5b1-7543f6b78d03 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1266 microversion: 2.1 time: 0.255761 Aug 29 21:41:17.908785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 402/795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:17 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:18.937531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:18.940571 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:18.971798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:18.972794 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:18.973682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:18.978159 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:18.978912 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:18.979865 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:19.031966 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:19.140856 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:19.171090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-369391cd-36e2-446e-92f0-7e946694421b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1272 microversion: 2.1 time: 0.237151 Aug 29 21:41:19.174942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 394/796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:18 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:19.665966 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-95d74bdb-733d-4405-b826-0b9463c0483c tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Action: 'create', calling method: .version_select at 0x7f5402a24670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-340780603", "metadata": {"Type": "work"}}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:20.211104 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-95d74bdb-733d-4405-b826-0b9463c0483c tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.788144 Aug 29 21:41:20.213001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 403/797] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 21:41:19 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 796 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:41:20.215754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:20.216890 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:20.227121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9836da8a-4dd8-4e76-957d-0edfebcc86ff tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Calling method '.version_select at 0x7f5402a8c700>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:20.233932 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:20.253565 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:20.254236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:20.255585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:20.256409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:20.257202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:20.310704 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9836da8a-4dd8-4e76-957d-0edfebcc86ff tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1" status: 200 len: 352 microversion: 2.1 time: 0.087146 Aug 29 21:41:20.316844 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 404/798] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:41:20 2022] GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:20.510777 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:20.521444 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9d997b9f-0a7f-4be1-b28e-9f9a2b3f9fb2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.311399 Aug 29 21:41:20.522296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 395/799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:20 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:21.333565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a9107063-2610-4e10-bbb3-6721cae73265 tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Calling method '.version_select at 0x7f5402a8cb80>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:21.413992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a9107063-2610-4e10-bbb3-6721cae73265 tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1" status: 200 len: 352 microversion: 2.1 time: 0.090721 Aug 29 21:41:21.414848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 405/800] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:41:21 2022] GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:21.551848 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:21.553991 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:21.565097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:21.566292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:21.567629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:21.568684 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:21.569845 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:21.570438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:21.898327 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:21.912181 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a88663e5-b1fc-47f6-a31b-b0ef57227201 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.366308 Aug 29 21:41:21.913206 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 396/801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:21 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:22.166298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-602d7120-c507-43b4-b3a9-25b1f72430e4 req-9fe840d9-643a-4f15-afe5-818f56733517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7cc698e-5f6b-43f5-9b32-89329a93b6c8", "tag": "541e28ab-fc0f-452b-a364-3542fd6cd927"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:22.176213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:22.180810 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-602d7120-c507-43b4-b3a9-25b1f72430e4 req-9fe840d9-643a-4f15-afe5-818f56733517 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:22.181180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-602d7120-c507-43b4-b3a9-25b1f72430e4 req-9fe840d9-643a-4f15-afe5-818f56733517 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:22.181933 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-602d7120-c507-43b4-b3a9-25b1f72430e4 req-9fe840d9-643a-4f15-afe5-818f56733517 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:22.202057 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-602d7120-c507-43b4-b3a9-25b1f72430e4 req-9fe840d9-643a-4f15-afe5-818f56733517 service nova] Creating event network-changed:541e28ab-fc0f-452b-a364-3542fd6cd927 for instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 on hv-cinder-85426 Aug 29 21:41:22.211249 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-602d7120-c507-43b4-b3a9-25b1f72430e4 req-9fe840d9-643a-4f15-afe5-818f56733517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051250 Aug 29 21:41:22.212231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 406/802] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:22.432489 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d514cc95-e2d0-4b88-aede-6ece409ca1e0 tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Calling method '.version_select at 0x7f5402a175e0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:22.508324 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d514cc95-e2d0-4b88-aede-6ece409ca1e0 tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1" status: 200 len: 353 microversion: 2.1 time: 0.082680 Aug 29 21:41:22.509640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 397/803] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:41:22 2022] GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:22.530008 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-480fa0f1-9f8e-4671-8214-507631503866 tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Calling method '.version_select at 0x7f5402a79280>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:22.603786 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-480fa0f1-9f8e-4671-8214-507631503866 tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1" status: 200 len: 353 microversion: 2.1 time: 0.084105 Aug 29 21:41:22.604349 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 407/804] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:41:22 2022] GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:22.639071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b96de69a-8162-4c82-b857-c00b34e9a8ea tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Calling method '.version_select at 0x7f5402a34ca0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:22.758923 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b96de69a-8162-4c82-b857-c00b34e9a8ea tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1" status: 202 len: 0 microversion: 2.1 time: 0.132026 Aug 29 21:41:22.759578 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 398/805] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 21:41:22 2022] DELETE /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:41:22.769987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-23db7667-93ba-4d68-ab34-1c667c9fb51a tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Calling method '.version_select at 0x7f5402a43e50>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:22.849303 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-23db7667-93ba-4d68-ab34-1c667c9fb51a tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1" status: 200 len: 352 microversion: 2.1 time: 0.083050 Aug 29 21:41:22.850494 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 408/806] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:41:22 2022] GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:22.948104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:22.949523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:22.961202 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:22.962436 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:22.964292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:22.966105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:22.969931 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:22.971045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:23.187098 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:23.201841 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-56f1ff88-e7c5-45d0-a54a-853bff16becb tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.260828 Aug 29 21:41:23.202848 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 399/807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:22 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:23.869646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2e2eb7a4-5222-4efc-837a-2aab5c6a0efb tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Calling method '.version_select at 0x7f5402a28790>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:23.900508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-2e2eb7a4-5222-4efc-837a-2aab5c6a0efb tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] HTTP exception thrown: Volume 314ce423-af07-491d-be46-191eea6152f1 could not be found. Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2e2eb7a4-5222-4efc-837a-2aab5c6a0efb tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Request method failure captured: Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 HTTP/1.1 Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTJ_nJsy5IbzHTrgZI9Fii85MrZJf6phkcKqntg9TxlCogSvFxN7GnFoknzY6BauVN2DSBm6gdalL87Xa7QlLFbT33SNooRhGT_a3fcDDK-8WPdU0gs8Sf8U3IBaYfN_AewyF05DvRgBMiF7HriR0XB1KszswEZdEBb_8QqoHUdje5Q Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: d8ee70f927b3424f9ec331327802f41e Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-VolumesGetTestJSON-1649331507 Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:41:23.903101 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d8ee70f927b3424f9ec331327802f41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d8ee70f927b3424f9ec331327802f41e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d8ee70f927b3424f9ec331327802f41e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d8ee70f927b3424f9ec331327802f41e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-VolumesGetTestJSON-1649331507 Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: d8ee70f927b3424f9ec331327802f41e Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-VolumesGetTestJSON-1649331507 Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-VolumesGetTestJSON-1649331507-project Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: ccfd745684914e9c87db030451813918 Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-VolumesGetTestJSON-1649331507-project Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Volume 314ce423-af07-491d-be46-191eea6152f1 could not be found. Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '314ce423-af07-491d-be46-191eea6152f1'} Aug 29 21:41:23.905345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 314ce423-af07-491d-be46-191eea6152f1 could not be found. (HTTP 404) (Request-ID: req-885b534e-860f-4266-94c2-ff2f977479b4) Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:23.906887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:41:23.908848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 314ce423-af07-491d-be46-191eea6152f1 could not be found. Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:41:23.911466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 314ce423-af07-491d-be46-191eea6152f1 could not be found. Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 314ce423-af07-491d-be46-191eea6152f1 could not be found. Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2e2eb7a4-5222-4efc-837a-2aab5c6a0efb tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] Returning 404 to user: Volume 314ce423-af07-491d-be46-191eea6152f1 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2e2eb7a4-5222-4efc-837a-2aab5c6a0efb tempest-VolumesGetTestJSON-1649331507 tempest-VolumesGetTestJSON-1649331507-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1" status: 404 len: 109 microversion: 2.1 time: 0.041588 Aug 29 21:41:23.913541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 409/808] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 21:41:23 2022] GET /compute/v2.1/os-volumes/314ce423-af07-491d-be46-191eea6152f1 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:24.235208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:24.236175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:24.247871 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.248676 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.249395 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.250531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.251257 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.251965 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.434171 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:24.444847 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-210bea6e-01b8-4164-b21e-6d1348371a5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.214477 Aug 29 21:41:24.445741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 400/809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:24 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:25.473709 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:25.474558 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:25.484944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:25.485818 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:25.486618 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:25.488097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:25.489075 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:25.489893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:25.498601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=38 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:25.715499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:25.726716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d59c2ffd-9395-4fe5-b94f-be37665e5362 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.260741 Aug 29 21:41:25.727934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 410/810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:25 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:26.750523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:26.751291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:26.753923 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:26.768671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:26.769521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:26.770142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:26.771142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:26.771603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:26.779733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:27.124897 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:27.142566 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-dbbe4639-eda3-4d8a-9e7a-3fa96fc16225 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.395962 Aug 29 21:41:27.143622 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 401/811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:26 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:28.164889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:28.165518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:28.167469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:28.168143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:28.177280 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:28.177778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:28.178222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:28.178942 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:28.179751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:28.179899 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:28.362845 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:28.374487 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d0f4ce9d-5eaa-460b-bc4c-d4323ed70aaa tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.213787 Aug 29 21:41:28.375520 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 411/812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:28 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:28.401567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-09868fa0-7752-4ad2-b017-782ea388e132 req-33ccea57-e22f-450d-b855-41c360d98f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc698e-5f6b-43f5-9b32-89329a93b6c8", "name": "network-vif-plugged", "status": "completed", "tag": "541e28ab-fc0f-452b-a364-3542fd6cd927"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:28.416639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-09868fa0-7752-4ad2-b017-782ea388e132 req-33ccea57-e22f-450d-b855-41c360d98f42 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:28.417529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-09868fa0-7752-4ad2-b017-782ea388e132 req-33ccea57-e22f-450d-b855-41c360d98f42 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:28.418049 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-09868fa0-7752-4ad2-b017-782ea388e132 req-33ccea57-e22f-450d-b855-41c360d98f42 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:28.434238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-09868fa0-7752-4ad2-b017-782ea388e132 req-33ccea57-e22f-450d-b855-41c360d98f42 service nova] Creating event network-vif-plugged:541e28ab-fc0f-452b-a364-3542fd6cd927 for instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 on hv-cinder-85426 Aug 29 21:41:28.443671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-09868fa0-7752-4ad2-b017-782ea388e132 req-33ccea57-e22f-450d-b855-41c360d98f42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046726 Aug 29 21:41:28.444545 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 402/813] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:29.413291 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:29.413940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:29.424273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:29.424813 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:29.425258 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:29.426515 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:29.427330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:29.428093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:29.643395 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:29.655519 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5e19c562-c0cc-498e-a6de-3f5334ac2d5f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1314 microversion: 2.1 time: 0.250335 Aug 29 21:41:29.656264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 412/814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:29 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:30.687081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:30.688670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:30.698450 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:30.699229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:30.699875 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:30.700981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:30.701981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:30.702474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:30.925310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:30.942624 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f9e55f3b-a6ce-4dc8-ae36-4ffdce86d57b tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1463 microversion: 2.1 time: 0.260200 Aug 29 21:41:30.943722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 403/815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:30 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:30.996282 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:30.997830 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:31.008137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:31.008771 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:31.009217 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:31.009930 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:31.010386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:31.010809 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:31.053626 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:41:31.192503 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-84757dbd-0612-466f-8737-8142a04cf023 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 204 len: 0 microversion: 2.1 time: 0.200285 Aug 29 21:41:31.193430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 413/816] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:30 2022] DELETE /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:41:31.208275 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:31.209723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:31.222523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:31.223032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:31.223504 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:31.224237 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:31.224715 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:31.225336 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:31.450463 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:31.463701 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b7170582-98c2-4736-8815-b85fef6566b3 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1469 microversion: 2.1 time: 0.263562 Aug 29 21:41:31.476762 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 404/817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:31 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:32.499852 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:32.501273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:32.510606 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:32.511731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:32.512297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:32.513128 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:32.514435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:32.514911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:32.896537 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:32.906365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-44a44d4b-cc8e-49eb-9010-4a28143883c2 tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1469 microversion: 2.1 time: 0.413534 Aug 29 21:41:32.921094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 414/818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:32 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:33.510390 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-cf5b1c26-a8dd-49fa-bae0-ea0fe6bc850d req-bf1d9546-548f-4e12-8836-7b45e0ea1507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc698e-5f6b-43f5-9b32-89329a93b6c8", "name": "network-vif-deleted", "tag": "541e28ab-fc0f-452b-a364-3542fd6cd927"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:33.524102 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-cf5b1c26-a8dd-49fa-bae0-ea0fe6bc850d req-bf1d9546-548f-4e12-8836-7b45e0ea1507 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:33.525074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-cf5b1c26-a8dd-49fa-bae0-ea0fe6bc850d req-bf1d9546-548f-4e12-8836-7b45e0ea1507 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:33.525717 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-cf5b1c26-a8dd-49fa-bae0-ea0fe6bc850d req-bf1d9546-548f-4e12-8836-7b45e0ea1507 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:33.539917 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-cf5b1c26-a8dd-49fa-bae0-ea0fe6bc850d req-bf1d9546-548f-4e12-8836-7b45e0ea1507 service nova] Creating event network-vif-deleted:541e28ab-fc0f-452b-a364-3542fd6cd927 for instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 on hv-cinder-85426 Aug 29 21:41:33.546640 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-cf5b1c26-a8dd-49fa-bae0-ea0fe6bc850d req-bf1d9546-548f-4e12-8836-7b45e0ea1507 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040454 Aug 29 21:41:33.552490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 405/819] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:33.936113 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:33.938851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:33.962528 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:33.963114 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:33.963610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:33.964613 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:33.965155 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:33.965686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:34.054262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:34.055092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:34.055905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:34.056728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lazy-loading 'fault' on Instance uuid b7cc698e-5f6b-43f5-9b32-89329a93b6c8 {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:41:34.148365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ab0d2a5e1b4b4ab4378bd89d2db123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf312281cdc4ad4925d1815c3ac7881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:34.166723 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-da44f7ac-c393-434a-ada1-6abe478620da tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 200 len: 1304 microversion: 2.1 time: 0.238511 Aug 29 21:41:34.191805 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 415/820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:33 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 1304 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:35.200657 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:35.202929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] [instance: b7cc698e-5f6b-43f5-9b32-89329a93b6c8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:35.214396 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:35.215509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:35.216256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:35.217549 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:35.218161 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:35.218605 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:35.236146 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] HTTP exception thrown: Instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 could not be found. Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Request method failure captured: Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 HTTP/1.1 Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTJ4N8WbUT4CTT6z-3PUqwNSesGay03jZhRA40nKNJrYWllO_S1ZmCAhxyuxfN27S_NJcK0hTfQkADchtofwIkiKcCKnprXvZ0_cxXrDhvQ7ODVbU_f2_sBxq9JTTMFZlBSi2tAFUpOP9lLppvHyAk3G93AZfXd91kKfzzl9YUAr-5w Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: dbf312281cdc4ad4925d1815c3ac7881 Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesNegativeTest-13812616 Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:41:35.237870 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dbf312281cdc4ad4925d1815c3ac7881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbf312281cdc4ad4925d1815c3ac7881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbf312281cdc4ad4925d1815c3ac7881"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dbf312281cdc4ad4925d1815c3ac7881", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesNegativeTest-13812616 Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: dbf312281cdc4ad4925d1815c3ac7881 Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesNegativeTest-13812616 Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesNegativeTest-13812616-project Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: b8ab0d2a5e1b4b4ab4378bd89d2db123 Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesNegativeTest-13812616-project Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 could not be found. Aug 29 21:41:35.240846 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': 'b7cc698e-5f6b-43f5-9b32-89329a93b6c8'} Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 could not be found. Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:35.243787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 could not be found. Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 could not be found. Aug 29 21:41:35.246585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:41:35.248925 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] Returning 404 to user: Instance b7cc698e-5f6b-43f5-9b32-89329a93b6c8 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:35.248925 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d7226034-5203-4b96-95fb-8475efe2828f tempest-VolumesNegativeTest-13812616 tempest-VolumesNegativeTest-13812616-project] 10.222.0.20 "GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8" status: 404 len: 111 microversion: 2.1 time: 0.047288 Aug 29 21:41:35.248925 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 406/821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:35 2022] GET /compute/v2.1/servers/b7cc698e-5f6b-43f5-9b32-89329a93b6c8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:52.484472 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1213137491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-796113926", "security_groups": [{"name": "tempest-secgroup-smoke-365737483"}], "block_device_mapping_v2": [{"uuid": "186aea4f-2c00-4f27-bb06-3c8e9ce0a207", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5e837a9d-67f3-4836-bdab-0e762646c779"}]}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:52.504299 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:52.505510 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:52.783075 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] validate_networks() for [('5e837a9d-67f3-4836-bdab-0e762646c779', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:41:53.673367 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:41:53.673972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:41:53.674734 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:41:53.676726 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:41:53.678153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:41:53.717386 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.718294 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.719458 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.721285 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.723124 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.724550 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.766057 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for project 98d4703c6737454291724a5ad15c9cbb. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:41:53.780681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Getting quotas for user d882c87d5de7497b822ec7b1798d2008 and project 98d4703c6737454291724a5ad15c9cbb. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:41:53.903750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:41:53.909585 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='186aea4f-2c00-4f27-bb06-3c8e9ce0a207',volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:41:54.290268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d329fee7-136e-4a9e-a801-b41c63fccee1 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.809852 Aug 29 21:41:54.291555 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 416/822] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:41:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:41:54.309964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9b4b28e1-2c99-4a82-bbb7-66e3a8d0418f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:54.312649 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9b4b28e1-2c99-4a82-bbb7-66e3a8d0418f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:54.323152 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:54.324488 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=53 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:54.638406 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9b4b28e1-2c99-4a82-bbb7-66e3a8d0418f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:54.649965 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9b4b28e1-2c99-4a82-bbb7-66e3a8d0418f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1094 microversion: 2.1 time: 0.346941 Aug 29 21:41:54.673290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 407/823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:54 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1094 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:55.698239 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:55.699130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:55.734872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:55.735423 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:55.735880 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:55.736657 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:55.737140 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:55.737617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:55.994588 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:56.031982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6b43224a-9119-4fd0-9923-b05dec57e719 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1144 microversion: 2.1 time: 0.341346 Aug 29 21:41:56.032987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 417/824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:55 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1144 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:57.071057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:57.073523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:57.139175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:57.139912 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:57.140627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:57.142005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:57.142825 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:57.143754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:57.398113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:57.406772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b8583929-0045-43c5-8699-acb39f802083 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1192 microversion: 2.1 time: 0.341757 Aug 29 21:41:57.424817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 408/825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:57 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1192 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:58.438297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:58.441767 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:58.479836 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:58.483087 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:58.486488 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:58.490997 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:58.494121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:58.495744 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:59.136766 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:59.172979 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-57fb5cef-f111-4768-8a46-af5c1de4ebcd tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1210 microversion: 2.1 time: 0.742657 Aug 29 21:41:59.200575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 418/826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:58 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1210 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:00.220825 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:00.225462 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:00.258386 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:00.259445 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:00.264455 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:00.268969 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:00.272748 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:00.276104 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:01.151518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:01.189741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-77d49271-b549-4d21-9495-0c95f019b854 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.968089 Aug 29 21:42:01.228133 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 409/827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:00 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:02.237670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:02.238984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:02.263490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:02.264879 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:02.267924 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:02.271707 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:02.272231 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:02.275865 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:02.739568 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:02.762796 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ee628b20-286a-49af-9d3c-eb5359bd7fe4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.530590 Aug 29 21:42:02.781092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 419/828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:02 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:03.356380 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-348038706", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "networks": [{"uuid": "232cf447-28fa-40a6-80b9-0c467edd0554"}]}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:03.594381 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] validate_networks() for [('232cf447-28fa-40a6-80b9-0c467edd0554', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:42:03.800962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:03.801856 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:03.811067 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:03.813328 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:03.818312 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:03.822964 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:03.825178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:03.826142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:03.830708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:03.836146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:04.422945 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:04.442530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cbf09feb-ce86-4f4e-bb83-dc2f55b410cc tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.655225 Aug 29 21:42:04.443895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 420/829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:03 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:04.452480 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-69a1c879-71e2-40b5-9dd6-9f618cb85b59 req-e9ffe318-f794-4e8d-9e91-2271c09745c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609a9478-ab5d-4c53-9efa-77d661126ebc", "tag": "d06909f2-99eb-4f38-b138-f0635d567f6b"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:04.466599 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-69a1c879-71e2-40b5-9dd6-9f618cb85b59 req-e9ffe318-f794-4e8d-9e91-2271c09745c5 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:04.467693 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-69a1c879-71e2-40b5-9dd6-9f618cb85b59 req-e9ffe318-f794-4e8d-9e91-2271c09745c5 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:04.468985 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-69a1c879-71e2-40b5-9dd6-9f618cb85b59 req-e9ffe318-f794-4e8d-9e91-2271c09745c5 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:04.501303 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-69a1c879-71e2-40b5-9dd6-9f618cb85b59 req-e9ffe318-f794-4e8d-9e91-2271c09745c5 service nova] Creating event network-changed:d06909f2-99eb-4f38-b138-f0635d567f6b for instance 609a9478-ab5d-4c53-9efa-77d661126ebc on hv-cinder-85426 Aug 29 21:42:04.519802 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-69a1c879-71e2-40b5-9dd6-9f618cb85b59 req-e9ffe318-f794-4e8d-9e91-2271c09745c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072651 Aug 29 21:42:04.522591 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 421/830] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:04.644240 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:05.087014 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:42:05.087450 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:42:05.088158 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:42:05.088542 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:42:05.089370 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:42:05.114175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:05.115075 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:05.116288 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:05.118585 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:05.120183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:05.121500 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:05.180048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Getting quotas for project d05e27bd70e64afbbc58379e64826217. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:42:05.185960 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Getting quotas for user eb53ae825eea452d9d456233ac2af43c and project d05e27bd70e64afbbc58379e64826217. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:42:05.239843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:42:05.250290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:42:05.391359 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4237d218-513e-4228-8404-d201c3e85db3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054550 Aug 29 21:42:05.399435 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 410/831] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:42:05.425817 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-df473f7c-3f8e-4f07-b521-91ee016fe9de tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:05.432341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-df473f7c-3f8e-4f07-b521-91ee016fe9de tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:05.486165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:05.487910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:05.572448 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:05.573478 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:05.574429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:05.575700 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:05.576512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:05.581889 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:06.439637 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-df473f7c-3f8e-4f07-b521-91ee016fe9de tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:06.468728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-df473f7c-3f8e-4f07-b521-91ee016fe9de tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1218 microversion: 2.1 time: 1.048724 Aug 29 21:42:06.469632 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 422/832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:05 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1218 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:06.720728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:06.746412 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ac18d47c-a0f5-418d-bb21-9389872a7ce9 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 1.269329 Aug 29 21:42:06.748745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 411/833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:05 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:07.516666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:07.519099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:07.562620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:07.567606 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:07.568347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:07.575943 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:07.579272 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:07.582924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:07.683155 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a9fdb833-1515-42c9-9f8a-d9ccc0bb34fe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Action: 'create', calling method: .version_select at 0x7f54029e7a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-761554983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd7KLS/GiQs5TP6P1zypWLC0kQYaPEAAlDbpqP4zM3+tHgaof1921fjyjf4DL1eRWdyYZ/jo6eOolCra+/G9LFifPUNtmeR4FzbUGKxNeDoSzY5zacFxdunc6onuHd7Ag=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:07.761610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-a9fdb833-1515-42c9-9f8a-d9ccc0bb34fe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Getting quotas for project 2d9fa722c18045678015c7b300ccc3ab. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:42:07.785831 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-a9fdb833-1515-42c9-9f8a-d9ccc0bb34fe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Getting quotas for user 4a20bdc6eee841258bd6ac11a8095a4a and project 2d9fa722c18045678015c7b300ccc3ab. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:42:07.845424 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:07.880708 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a9fdb833-1515-42c9-9f8a-d9ccc0bb34fe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.403935 Aug 29 21:42:07.885137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 423/834] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:42:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:07.903516 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-03b8268d-1db6-4f29-a38c-5fbfef9141ad tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1270 microversion: 2.1 time: 0.395391 Aug 29 21:42:07.909954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 412/835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:07 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1270 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:07.912577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:07.914921 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:07.941371 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:07.942612 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:07.944610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:07.959118 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:07.961206 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:07.963179 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:08.940958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:08.941674 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:08.955847 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:08.972009 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:08.977879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:08.981849 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:08.986264 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:08.988667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-30a72409-4f90-41e3-affe-1d4a43ece17c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 1.096943 Aug 29 21:42:08.990046 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:08.990812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:08.994785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 424/836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:07 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:09.204181 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:09.240302 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-945a6188-7094-4be6-a027-4e37c7b3df65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1276 microversion: 2.1 time: 0.302531 Aug 29 21:42:09.245869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 413/837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:08 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:10.034428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:10.041090 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:10.079943 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:10.082610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:10.087430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:10.091092 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:10.093735 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:10.098378 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:10.278898 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:10.285308 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:10.305099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:10.305924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:10.306438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:10.307515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:10.308331 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:10.310638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:10.977719 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:10.993722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-24a3eb54-2363-4298-b4cc-c4ca7a4b8e37 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.728447 Aug 29 21:42:11.008406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:11.024269 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 414/838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:10 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:11.029234 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d26eea33-de0c-4264-8b71-2bb246a098fa tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 1.004747 Aug 29 21:42:11.030254 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 425/839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:10 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:12.022610 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:12.024801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:12.039876 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.041326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.043698 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.046238 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.048208 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.049401 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.060168 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:12.061923 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:12.102084 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.104619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.107570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.110009 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.110819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.113694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.373127 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:12.387323 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-75ab238d-8843-48a4-83e1-1e1e0928344a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.371168 Aug 29 21:42:12.403069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 415/840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:12 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:12.415349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-70f63268-9e37-433a-a2ff-6542a87b94d6 req-48881781-0d67-4fde-b47a-630288891fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44fce006-b99f-46a3-ac0c-68e2a6914659", "tag": "02e09094-d997-4f4d-8d32-57228f28b520"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:12.444167 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-70f63268-9e37-433a-a2ff-6542a87b94d6 req-48881781-0d67-4fde-b47a-630288891fc7 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.444709 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-70f63268-9e37-433a-a2ff-6542a87b94d6 req-48881781-0d67-4fde-b47a-630288891fc7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.445153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-70f63268-9e37-433a-a2ff-6542a87b94d6 req-48881781-0d67-4fde-b47a-630288891fc7 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.465490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-70f63268-9e37-433a-a2ff-6542a87b94d6 req-48881781-0d67-4fde-b47a-630288891fc7 service nova] Creating event network-changed:02e09094-d997-4f4d-8d32-57228f28b520 for instance 44fce006-b99f-46a3-ac0c-68e2a6914659 on hv-cinder-85426 Aug 29 21:42:12.475317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-70f63268-9e37-433a-a2ff-6542a87b94d6 req-48881781-0d67-4fde-b47a-630288891fc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063890 Aug 29 21:42:12.478896 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 416/841] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:12.633980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:12.659402 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e5701a19-3d18-4249-aa20-0b0beeb92e48 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.604243 Aug 29 21:42:12.673588 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 426/842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:12 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:13.417532 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:13.418450 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:13.429338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.430211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.430853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.431741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.432362 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.432721 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.686801 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:13.687464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:13.707980 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.708855 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.710192 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.712201 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.713427 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.716509 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.785211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:13.809372 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-140cc7ae-3354-4f20-b330-702243e0d5a6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.397889 Aug 29 21:42:13.821683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 417/843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:13 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:14.085700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:14.109863 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f1662131-d66f-4c05-8e6d-177475fe7430 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.421813 Aug 29 21:42:14.126717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 427/844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:13 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:14.862215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:14.864929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:14.883085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:14.884123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:14.886082 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:14.887081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:14.887553 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:14.888983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:15.141940 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:15.143759 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:15.144711 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:15.179275 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:15.186339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:15.187414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:15.188517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:15.193676 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:15.200211 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:15.211674 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:15.259067 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:15.274682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8a38f57f-20ca-459a-a333-9285d0711c65 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.421231 Aug 29 21:42:15.293652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 418/845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:14 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:15.554747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:15.573138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e212ad9b-e710-4c30-963c-d832faf84611 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.438048 Aug 29 21:42:15.579293 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 428/846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:15 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:16.320747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:16.322079 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:16.337347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:16.338271 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:16.339129 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:16.340781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:16.341722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:16.342568 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:16.626323 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:16.627807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:16.652780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:16.660270 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:16.661526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:16.664832 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:16.669678 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:16.671096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:16.748205 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:16.776023 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b9e14580-a554-4497-89a5-c8a812fe310d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.461864 Aug 29 21:42:16.803647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 419/847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:16 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:17.070777 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:17.088577 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cf7fbc88-82f6-4bbc-bbfc-ea78672638ac tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.476090 Aug 29 21:42:17.090498 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 429/848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:16 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:17.200226 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-4e41804f-a83a-42d9-a645-57feead5c9f1 req-4fe94ded-567b-422b-9acf-9416e12bea1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609a9478-ab5d-4c53-9efa-77d661126ebc", "name": "network-vif-plugged", "status": "completed", "tag": "d06909f2-99eb-4f38-b138-f0635d567f6b"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:17.235485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4e41804f-a83a-42d9-a645-57feead5c9f1 req-4fe94ded-567b-422b-9acf-9416e12bea1b service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:17.235485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4e41804f-a83a-42d9-a645-57feead5c9f1 req-4fe94ded-567b-422b-9acf-9416e12bea1b service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:17.248047 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-4e41804f-a83a-42d9-a645-57feead5c9f1 req-4fe94ded-567b-422b-9acf-9416e12bea1b service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:17.298591 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-4e41804f-a83a-42d9-a645-57feead5c9f1 req-4fe94ded-567b-422b-9acf-9416e12bea1b service nova] Creating event network-vif-plugged:d06909f2-99eb-4f38-b138-f0635d567f6b for instance 609a9478-ab5d-4c53-9efa-77d661126ebc on hv-cinder-85426 Aug 29 21:42:17.325888 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-4e41804f-a83a-42d9-a645-57feead5c9f1 req-4fe94ded-567b-422b-9acf-9416e12bea1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135632 Aug 29 21:42:17.331911 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 420/849] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:17.813536 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:17.814221 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:17.824079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:17.841551 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:17.842439 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:17.843606 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:17.845171 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:17.846098 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:17.847203 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:18.131519 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:18.133531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:18.145286 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:18.149960 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:18.149960 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:18.150746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:18.152372 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:18.153361 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:18.154681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:18.168059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8bbd22c4-371a-4518-a092-2ff0d454b587 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.363342 Aug 29 21:42:18.171655 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 430/850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:17 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:18.437561 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:18.466062 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2d8812b7-3bdb-42a9-a942-cbeea618412d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1265 microversion: 2.1 time: 0.344412 Aug 29 21:42:18.467251 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 421/851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:18 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:19.206142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:19.207209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:19.225919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.226689 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.227326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.228825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.229875 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.230607 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.365194 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-fdf8b9d7-6ad4-4f2b-843a-97e472942f24 req-199b357a-e4dd-4de6-bdc6-21fb008a9fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44fce006-b99f-46a3-ac0c-68e2a6914659", "name": "network-vif-plugged", "status": "completed", "tag": "02e09094-d997-4f4d-8d32-57228f28b520"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:19.393370 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-fdf8b9d7-6ad4-4f2b-843a-97e472942f24 req-199b357a-e4dd-4de6-bdc6-21fb008a9fef service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.394862 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-fdf8b9d7-6ad4-4f2b-843a-97e472942f24 req-199b357a-e4dd-4de6-bdc6-21fb008a9fef service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.397278 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-fdf8b9d7-6ad4-4f2b-843a-97e472942f24 req-199b357a-e4dd-4de6-bdc6-21fb008a9fef service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.426369 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-fdf8b9d7-6ad4-4f2b-843a-97e472942f24 req-199b357a-e4dd-4de6-bdc6-21fb008a9fef service nova] Creating event network-vif-plugged:02e09094-d997-4f4d-8d32-57228f28b520 for instance 44fce006-b99f-46a3-ac0c-68e2a6914659 on hv-cinder-85426 Aug 29 21:42:19.435787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-fdf8b9d7-6ad4-4f2b-843a-97e472942f24 req-199b357a-e4dd-4de6-bdc6-21fb008a9fef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076555 Aug 29 21:42:19.436983 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 422/852] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:42:19.493554 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:19.495372 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:19.509010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.509010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.509010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.509010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.509651 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.509651 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.533018 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:19.550992 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f9a202ba-c8a2-4c7a-b3a0-829834153d47 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.349920 Aug 29 21:42:19.552898 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 431/853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:19 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:19.776819 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:19.799340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7b05b650-f993-4811-94c3-30dfa6c93276 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1451 microversion: 2.1 time: 0.310449 Aug 29 21:42:19.800167 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 423/854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:19 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1451 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:19.823875 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:19.824703 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:19.832982 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.833539 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.834167 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:19.835738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:19.836392 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:19.836881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:20.136815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:20.150898 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-eaf098b8-282e-449f-9a36-a9ee160a2e8d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1451 microversion: 2.1 time: 0.332078 Aug 29 21:42:20.152393 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 432/855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:19 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1451 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:20.581160 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:20.582060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:20.593057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:20.594319 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:20.595215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:20.596877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:20.597977 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:20.598897 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:21.043045 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:21.065076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a4cd08e1-6ba2-416d-8acb-d09891deac2e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1318 microversion: 2.1 time: 0.492983 Aug 29 21:42:21.067370 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 424/856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:20 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:22.124439 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:22.125787 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:22.143799 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:22.145170 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:22.145868 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:22.147325 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:22.148034 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:22.148809 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:22.474079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:22.488041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7ca840b3-fc66-4ae1-861a-5f99dda0cd2d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1507 microversion: 2.1 time: 0.374926 Aug 29 21:42:22.489387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 433/857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:22 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:23.923393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-f8b0a893-803e-48c2-a1e8-f80b48375725 req-49ec1512-a1ef-4377-b851-965bd387db98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609a9478-ab5d-4c53-9efa-77d661126ebc", "tag": "d06909f2-99eb-4f38-b138-f0635d567f6b"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:23.944384 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-f8b0a893-803e-48c2-a1e8-f80b48375725 req-49ec1512-a1ef-4377-b851-965bd387db98 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:23.945175 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-f8b0a893-803e-48c2-a1e8-f80b48375725 req-49ec1512-a1ef-4377-b851-965bd387db98 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:23.945809 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-f8b0a893-803e-48c2-a1e8-f80b48375725 req-49ec1512-a1ef-4377-b851-965bd387db98 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:24.164671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-f8b0a893-803e-48c2-a1e8-f80b48375725 req-49ec1512-a1ef-4377-b851-965bd387db98 service nova] Creating event network-changed:d06909f2-99eb-4f38-b138-f0635d567f6b for instance 609a9478-ab5d-4c53-9efa-77d661126ebc on hv-cinder-85426 Aug 29 21:42:24.174315 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-f8b0a893-803e-48c2-a1e8-f80b48375725 req-49ec1512-a1ef-4377-b851-965bd387db98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255649 Aug 29 21:42:24.175394 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 425/858] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:34.483297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1800112120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-761554983", "security_groups": [{"name": "tempest-secgroup-smoke-374171547"}], "networks": [{"uuid": "4e0b5072-8f8a-441e-afcb-5c3313ae7900"}], "block_device_mapping_v2": [{"uuid": "ea409a7f-eed8-4ffa-9e44-f53351011819", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:34.504561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:34.506057 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=88 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:34.710905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.network.neutron [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] validate_networks() for [('4e0b5072-8f8a-441e-afcb-5c3313ae7900', None, None, None, None, None)] {{(pid=127216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:42:35.467311 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Flavor limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:42:35.467755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Image limits 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:42:35.468222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Flavor pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:42:35.469664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Image pref 0:0:0 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:42:35.469664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.virt.hardware [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:42:35.481884 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:35.482522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:35.483067 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:35.483896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:35.484632 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:35.485326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:35.512381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Getting quotas for project 2d9fa722c18045678015c7b300ccc3ab. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:42:35.518154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Getting quotas for user 4a20bdc6eee841258bd6ac11a8095a4a and project 2d9fa722c18045678015c7b300ccc3ab. Resources: {'cores', 'instances', 'ram'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:42:35.646814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Going to run 1 instances... {{(pid=127216) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:42:35.653015 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea409a7f-eed8-4ffa-9e44-f53351011819',volume_size=None,volume_type=None)] {{(pid=127216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:42:35.905542 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b12f158b-18dc-49a1-a629-293101e09550 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.427386 Aug 29 21:42:35.906679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 434/859] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:42:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:42:35.922561 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:35.925854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=88 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:35.938535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-2d261a5f-bd23-49fc-a950-8dbd5262b887 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:35.940395 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-2d261a5f-bd23-49fc-a950-8dbd5262b887 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:36.078930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-2d261a5f-bd23-49fc-a950-8dbd5262b887 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:36.092103 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-2d261a5f-bd23-49fc-a950-8dbd5262b887 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1088 microversion: 2.1 time: 0.171640 Aug 29 21:42:36.094950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 426/860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:35 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1088 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:37.128549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:37.130432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:37.142290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:37.143618 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:37.144732 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:37.146153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:37.146919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:37.147587 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:37.257754 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:37.271281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3bd68ab7-52b1-485e-8d24-1c585492adc8 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1186 microversion: 2.1 time: 0.149161 Aug 29 21:42:37.272061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 435/861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:37 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1186 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:38.309091 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:38.309707 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:38.329819 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:38.330639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:38.331409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:38.332668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:38.333405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:38.334060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:38.453201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:38.480149 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-3ac8937f-c5f3-45d3-ad24-3aac7bbe0cc2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1204 microversion: 2.1 time: 0.174615 Aug 29 21:42:38.481444 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 427/862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:38 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1204 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:39.524616 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:39.525819 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:39.539406 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:39.540261 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:39.541098 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:39.542230 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:39.543479 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:39.544740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:39.772705 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:39.787220 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d34719bb-5917-4d18-9530-eccbe25cba12 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.272659 Aug 29 21:42:39.810035 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 436/863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:39 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:40.206514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-b3b0ca2b-2fd6-47c2-9d99-521825ad519d req-dc19a3a4-f1ea-4f59-a264-7145362dddcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5aa400-130f-4951-beee-2f3773dd590c", "tag": "8ba48673-7c7e-419d-94e5-60999c7e242e"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:40.219627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-b3b0ca2b-2fd6-47c2-9d99-521825ad519d req-dc19a3a4-f1ea-4f59-a264-7145362dddcc service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:40.220427 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-b3b0ca2b-2fd6-47c2-9d99-521825ad519d req-dc19a3a4-f1ea-4f59-a264-7145362dddcc service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:40.221351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-b3b0ca2b-2fd6-47c2-9d99-521825ad519d req-dc19a3a4-f1ea-4f59-a264-7145362dddcc service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:40.235373 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-b3b0ca2b-2fd6-47c2-9d99-521825ad519d req-dc19a3a4-f1ea-4f59-a264-7145362dddcc service nova] Creating event network-changed:8ba48673-7c7e-419d-94e5-60999c7e242e for instance 1a5aa400-130f-4951-beee-2f3773dd590c on hv-cinder-85426 Aug 29 21:42:40.241692 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-b3b0ca2b-2fd6-47c2-9d99-521825ad519d req-dc19a3a4-f1ea-4f59-a264-7145362dddcc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039913 Aug 29 21:42:40.242316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 428/864] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:42:40.825582 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:40.826615 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:40.837477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:40.838363 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:40.839166 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:40.840430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:40.841620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:40.842175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:41.065016 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:41.078900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-05842ff3-d2ad-4cc6-b51c-783ae54e585d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.258194 Aug 29 21:42:41.080764 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 437/865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:40 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:42.122312 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:42.123631 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:42.137497 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:42.138279 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:42.139036 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:42.142105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:42.143572 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:42.144413 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:42.375638 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:42.389163 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6602386a-5ee9-49aa-867f-38536212c4aa tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.276498 Aug 29 21:42:42.390121 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 429/866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:42 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:43.425209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:43.426121 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:43.435667 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:43.436477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:43.437564 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:43.438696 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:43.439507 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:43.440075 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:43.658453 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:43.670660 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7ef84222-d7e2-4c2c-948b-d1371ce8f19a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.250775 Aug 29 21:42:43.671557 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 438/867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:43 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:44.707147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:44.708685 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:44.719590 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:44.720270 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:44.720917 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:44.721770 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:44.722409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:44.722948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:44.952888 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:44.964365 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c42f9338-c945-466e-9d36-f2db025a888b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.265555 Aug 29 21:42:44.964947 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 430/868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:44 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:45.990540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:45.991625 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:45.993962 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:45.994740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:46.002557 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:46.003054 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:46.003498 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:46.004212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:46.004776 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:46.005355 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:46.207214 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:46.220435 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-21b7623a-6660-48fb-ae35-73b5d9f1b18e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.236675 Aug 29 21:42:46.222377 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 439/869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:45 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:47.256149 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:47.257029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:47.259948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:47.266128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:47.267183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:47.267645 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:47.268441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:47.268942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:47.269372 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:47.484769 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:47.499772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8feced07-e69a-416f-8cd4-5311a07ba338 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.249582 Aug 29 21:42:47.501621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 431/870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:47 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:48.524561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:48.525277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:48.533079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:48.533827 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:48.534525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:48.535688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:48.536490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:48.537212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:48.721978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:48.731668 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-efad3593-c539-4c6c-b290-99d830243c1d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.211158 Aug 29 21:42:48.732772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 440/871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:48 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:49.754930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:49.755653 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:49.762617 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:49.763274 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:49.763734 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:49.764512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:49.765277 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:49.765725 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:49.980815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:49.989980 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9dcfe481-9d47-43f7-9755-6b3766eba92e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.240358 Aug 29 21:42:49.990570 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 432/872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:49 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:51.017413 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:51.018436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:51.030079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:51.030592 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:51.031046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:51.032042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:51.032644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:51.033683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:51.253375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:51.264743 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dbd51435-2ab8-4993-ad5d-07933ced5568 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.256654 Aug 29 21:42:51.265509 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 441/873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:51 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:52.299007 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:52.299711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:52.306825 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:52.307320 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:52.307757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:52.308457 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:52.308950 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:52.309375 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:52.496898 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:52.510124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-90ada257-4a3d-4b4d-91b1-ffdf104a635f tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.215194 Aug 29 21:42:52.510723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 433/874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:52 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:52.895458 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-f0d60240-daed-49d0-8042-9dd19087a24d req-a77a3d00-5e80-4dfc-9917-95977961c152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5aa400-130f-4951-beee-2f3773dd590c", "name": "network-vif-plugged", "status": "completed", "tag": "8ba48673-7c7e-419d-94e5-60999c7e242e"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:52.908700 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f0d60240-daed-49d0-8042-9dd19087a24d req-a77a3d00-5e80-4dfc-9917-95977961c152 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:52.909350 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f0d60240-daed-49d0-8042-9dd19087a24d req-a77a3d00-5e80-4dfc-9917-95977961c152 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:52.909791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f0d60240-daed-49d0-8042-9dd19087a24d req-a77a3d00-5e80-4dfc-9917-95977961c152 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:52.922840 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-f0d60240-daed-49d0-8042-9dd19087a24d req-a77a3d00-5e80-4dfc-9917-95977961c152 service nova] Creating event network-vif-plugged:8ba48673-7c7e-419d-94e5-60999c7e242e for instance 1a5aa400-130f-4951-beee-2f3773dd590c on hv-cinder-85426 Aug 29 21:42:52.928375 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-f0d60240-daed-49d0-8042-9dd19087a24d req-a77a3d00-5e80-4dfc-9917-95977961c152 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046346 Aug 29 21:42:52.929297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 442/875] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:53.534469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:53.535219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:53.542898 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:53.543661 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:53.544341 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:53.545470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:53.546214 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:53.546890 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:53.689467 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:53.698127 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1c1ed137-14c6-41c4-87be-c67b11db6c8d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.168777 Aug 29 21:42:53.698698 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 434/876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:53 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:54.727335 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:54.728072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:54.734790 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:54.735324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:54.735758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:54.736450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:54.736937 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:54.737359 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:54.879491 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:54.888816 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b75bd3ab-533f-47f1-b926-0252e06b4c08 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1259 microversion: 2.1 time: 0.168868 Aug 29 21:42:54.889419 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 443/877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:54 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:55.912930 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:55.913670 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:55.920907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:55.921400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:55.921832 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:55.923199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:55.923660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:55.924081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:56.099933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:56.113179 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d3675a02-9065-40d6-95a6-7996eda23504 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1444 microversion: 2.1 time: 0.205693 Aug 29 21:42:56.114123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 435/878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:55 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1444 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:56.133898 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:56.134750 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:56.141921 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:56.142415 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:56.142851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:56.143549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:56.144006 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:56.144430 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:56.314656 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:56.323570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c6fe412d-2fe9-4d8b-bdc0-4aa31c75c2ff tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1444 microversion: 2.1 time: 0.193524 Aug 29 21:42:56.324153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 444/879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:56 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1444 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:58.420904 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b135b730-0f61-4e73-86d4-5fbcff8d5b9d", "device": "/dev/sdb"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:58.424350 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:58.431016 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:58.431484 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:58.432283 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:58.433296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:58.433667 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:58.434093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:58.570176 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-13a4595f-73b0-4048-baad-2534737e3ee0 req-ba83229a-ffb4-48f0-8231-ce496d53784e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5aa400-130f-4951-beee-2f3773dd590c", "tag": "8ba48673-7c7e-419d-94e5-60999c7e242e"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:58.586742 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-13a4595f-73b0-4048-baad-2534737e3ee0 req-ba83229a-ffb4-48f0-8231-ce496d53784e service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:58.588100 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-13a4595f-73b0-4048-baad-2534737e3ee0 req-ba83229a-ffb4-48f0-8231-ce496d53784e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:58.589028 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-13a4595f-73b0-4048-baad-2534737e3ee0 req-ba83229a-ffb4-48f0-8231-ce496d53784e service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:58.623059 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-13a4595f-73b0-4048-baad-2534737e3ee0 req-ba83229a-ffb4-48f0-8231-ce496d53784e service nova] Creating event network-changed:8ba48673-7c7e-419d-94e5-60999c7e242e for instance 1a5aa400-130f-4951-beee-2f3773dd590c on hv-cinder-85426 Aug 29 21:42:58.630701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-13a4595f-73b0-4048-baad-2534737e3ee0 req-ba83229a-ffb4-48f0-8231-ce496d53784e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064431 Aug 29 21:42:58.631937 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 445/880] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:58.876085 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5e289f06-7516-4005-b5e0-690c3cc1832e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "POST /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457905 Aug 29 21:42:58.877465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 436/881] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:42:58 2022] POST /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:37.539688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:37.540989 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=60 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:37.548728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-aec5ec25-152f-4302-9fcd-394cd4cbb280 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Action: 'create', calling method: .version_select at 0x7f5402982160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-644343801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1185t9kKVtRvqHstLy469GriT7hv3r7fgHGHxHZMgQ4v2g4WOp3rXwa55sRCIh5IKkXBJc2i1xL+O8su9vIywH72yrF5JJW2XDnuP0tslSh/mEgvIhF3eETbMq7Bficw=="}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:37.579606 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-aec5ec25-152f-4302-9fcd-394cd4cbb280 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Getting quotas for project 84b949156c47430fae4f516e4c6d80ba. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:43:37.586742 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.quota [None req-aec5ec25-152f-4302-9fcd-394cd4cbb280 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Getting quotas for user ec929ddc024a4790b7091f60e4733cd4 and project 84b949156c47430fae4f516e4c6d80ba. Resources: {'key_pairs'} {{(pid=127216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:43:37.622987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-aec5ec25-152f-4302-9fcd-394cd4cbb280 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.085584 Aug 29 21:43:37.624625 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 446/882] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 21:43:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:37.685290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=24 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:37.686889 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:37.692105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2058389058", "imageRef": "e3ec3971-9686-4fb1-827a-4367f01d8136", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-644343801", "networks": [{"uuid": "e8c1cf9b-2739-4f89-adff-853fe242fc8e"}]}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:37.754505 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] validate_networks() for [('e8c1cf9b-2739-4f89-adff-853fe242fc8e', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:43:38.321801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:43:38.322733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:43:38.323747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:43:38.324525 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:43:38.325310 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:43:38.337181 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:38.337831 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:38.338513 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:38.339518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:38.340033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:38.340684 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:38.363077 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Getting quotas for project 84b949156c47430fae4f516e4c6d80ba. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:43:38.368019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Getting quotas for user ec929ddc024a4790b7091f60e4733cd4 and project 84b949156c47430fae4f516e4c6d80ba. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:43:38.382291 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:43:38.385099 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3ec3971-9686-4fb1-827a-4367f01d8136',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:43:38.435958 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6ced6f12-3a3a-4565-a427-5dd90f60361f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752398 Aug 29 21:43:38.436931 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 437/883] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:43:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:43:38.452353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-362ddf79-e120-4aad-819b-62ffddd682db tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:38.453707 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-362ddf79-e120-4aad-819b-62ffddd682db tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:38.544229 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-362ddf79-e120-4aad-819b-62ffddd682db tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:38.557749 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-362ddf79-e120-4aad-819b-62ffddd682db tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1258 microversion: 2.1 time: 0.111653 Aug 29 21:43:38.558785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 447/884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:38 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1258 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:39.200383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:39.201280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:39.213499 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:39.214467 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:39.215265 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:39.216087 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:39.216653 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:39.217088 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:39.328165 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lazy-loading 'services' on Instance uuid 44fce006-b99f-46a3-ac0c-68e2a6914659 {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:43:39.427543 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-6b8c8c83-5bbd-4205-a4e1-bad705ebebc8 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659/os-volume_attachments/b135b730-0f61-4e73-86d4-5fbcff8d5b9d" status: 202 len: 0 microversion: 2.1 time: 0.235414 Aug 29 21:43:39.428227 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 438/885] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:43:39 2022] DELETE /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659/os-volume_attachments/b135b730-0f61-4e73-86d4-5fbcff8d5b9d => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:43:39.581702 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:39.582527 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:39.589215 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:39.589706 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:39.590143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:39.590851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:39.591396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:39.591823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:39.691315 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:39.700322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9e958250-47a9-4e1e-89e6-7f45fe5c8b24 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1310 microversion: 2.1 time: 0.122826 Aug 29 21:43:39.701081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 448/886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:39 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1310 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:40.745416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:40.748677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:40.765569 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:40.766752 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:40.767683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:40.769317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:40.770321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:40.771416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:40.882060 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:40.894375 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ed0c7957-47ce-472f-9d9e-d00e4a906ee5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1316 microversion: 2.1 time: 0.166342 Aug 29 21:43:40.895339 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 439/887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:40 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:41.734688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:41.735530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:41.757238 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:41.758175 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:41.760387 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:41.761600 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:41.762462 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:41.763319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:41.856213 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:43:41.923523 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:41.924304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:41.947999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:41.957659 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:41.963114 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:41.965707 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:41.967854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:41.970112 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:42.015010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5f155684-21d6-47b7-88b8-b010b2f02e16 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 204 len: 0 microversion: 2.1 time: 0.283939 Aug 29 21:43:42.017705 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 449/888] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:43:41 2022] DELETE /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:43:42.038109 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:42.039126 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:42.056946 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:42.057987 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:42.058705 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:42.059948 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:42.060695 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:42.061373 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:42.330521 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:42.351338 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0094de62-d816-42b6-901e-0f8bca064cd8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.432240 Aug 29 21:43:42.352809 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 440/889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:41 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:42.439012 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:42.459814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6579ce9a-6230-46cb-b3a5-a8a8c7059db0 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.434478 Aug 29 21:43:42.460810 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 450/890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:42 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:43.381964 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:43.383185 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:43.391304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:43.391868 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:43.392385 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:43.393637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:43.394420 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:43.394944 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:43.493068 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:43.494182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:43.511024 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:43.511510 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:43.511955 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:43.513017 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:43.513568 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:43.514788 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:43.773049 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:43.783332 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-42697b65-f4b1-406e-bb99-bcd4f6260794 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.404886 Aug 29 21:43:43.796160 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 441/891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:43 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:43.824281 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:43.838913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1cab5167-9f52-48d6-9419-1817d61e8a39 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.351909 Aug 29 21:43:43.849342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 451/892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:43 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:44.817706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:44.820328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:44.832304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:44.833353 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:44.833965 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:44.834742 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:44.835250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:44.835729 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:44.867324 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:44.868181 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:44.875396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:44.875887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:44.876329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:44.877319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:44.877854 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:44.878292 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:45.126333 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:45.141950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:45.146836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-299545af-8721-49f4-9364-f546f0a0ba25 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.336880 Aug 29 21:43:45.160624 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 442/893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:44 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:45.160902 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7c58f1bd-60a6-4e05-8254-f2896fa9d46a tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.287117 Aug 29 21:43:45.160902 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 452/894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:44 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:46.180874 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:46.181758 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:46.182809 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:46.183706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:46.193767 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:46.194105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:46.194296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:46.194942 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:46.195081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:46.195795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:46.196337 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:46.196857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:46.197308 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:46.197529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:46.197799 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:46.197799 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:46.460515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:46.465277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:46.475876 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bc892c68-0cd6-4115-9fef-90e9bb6cbdcd tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.299530 Aug 29 21:43:46.485416 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 453/895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:46 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:46.487718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-215a9325-0bd9-4ddd-a939-9018fc3119c0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.311044 Aug 29 21:43:46.489307 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 443/896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:46 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:47.511304 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:47.512276 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:47.518535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:47.519747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:47.519747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:47.520416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:47.520643 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:47.520818 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:47.521393 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:47.521862 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:47.526990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:47.527389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:47.527949 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:47.528691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:47.529316 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:47.530260 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:47.849621 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:47.866556 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-87c8b39d-ce6b-44b8-b2e7-7fd8cb497134 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.360956 Aug 29 21:43:47.867548 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 454/897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:47 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:47.872997 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:47.891681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-73207892-7b47-4b72-a6f4-1f58e89442f9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.379049 Aug 29 21:43:47.901451 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 444/898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:47 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:48.896938 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:48.899522 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:48.915205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=6 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:48.923973 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:48.925354 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:48.926626 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:48.928336 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:48.929494 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:48.930601 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:48.937747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:48.938828 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:48.957672 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:48.959074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:48.971345 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:48.973095 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:48.974170 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:48.975655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:48.976405 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:48.977124 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:49.296363 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:49.306905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:49.310416 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ddd12807-c866-410f-869a-6985433803e7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.378572 Aug 29 21:43:49.311861 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 445/899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:48 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:49.330560 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a58d8a7f-6e0f-4f43-b5bb-2078ee1effcb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.440861 Aug 29 21:43:49.346474 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 455/900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:48 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:50.343910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:50.345066 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:50.354280 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:50.355706 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:50.356853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:50.359223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:50.360472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:50.361710 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:50.379040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:50.381404 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:50.413302 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:50.414157 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:50.414917 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:50.416183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:50.417037 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:50.417776 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:50.698417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:50.709804 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f9908275-0f17-4cfa-af58-b495870a91fe tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.371814 Aug 29 21:43:50.710885 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 446/901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:50 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:50.740064 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:50.753061 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0defec24-f799-48c5-8ed2-a01b1a976e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.389505 Aug 29 21:43:50.753834 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 456/902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:50 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:51.749989 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:51.751113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:51.762117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:51.762939 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:51.763691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:51.765446 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:51.765927 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:51.766368 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:51.777360 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:51.777994 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:51.798099 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:51.798909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:51.800465 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:51.801499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:51.802139 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:51.802864 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:52.105959 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:52.111163 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:52.127683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dbcb4918-4c97-414a-89c9-5e2612f1d755 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.355418 Aug 29 21:43:52.128485 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 457/903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:51 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:52.129403 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b2c7e3fc-ea5f-4d3a-a05a-18010456e41c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.385227 Aug 29 21:43:52.130222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 447/904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:51 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:52.430001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-fd7b49c9-05ea-4aa6-a980-a0b95bb2b9d6 req-3f5f087a-3ce8-468d-9a7e-45d0f868707c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abd7bcf-c166-4f1e-bb3b-094b5b189a9b", "tag": "01de6740-c3e7-4663-ae6d-d1f005bc9acc"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:52.439739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fd7b49c9-05ea-4aa6-a980-a0b95bb2b9d6 req-3f5f087a-3ce8-468d-9a7e-45d0f868707c service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:52.440552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fd7b49c9-05ea-4aa6-a980-a0b95bb2b9d6 req-3f5f087a-3ce8-468d-9a7e-45d0f868707c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:52.441552 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fd7b49c9-05ea-4aa6-a980-a0b95bb2b9d6 req-3f5f087a-3ce8-468d-9a7e-45d0f868707c service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:52.469171 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-fd7b49c9-05ea-4aa6-a980-a0b95bb2b9d6 req-3f5f087a-3ce8-468d-9a7e-45d0f868707c service nova] Creating event network-changed:01de6740-c3e7-4663-ae6d-d1f005bc9acc for instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b on hv-cinder-85426 Aug 29 21:43:52.475498 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-fd7b49c9-05ea-4aa6-a980-a0b95bb2b9d6 req-3f5f087a-3ce8-468d-9a7e-45d0f868707c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054322 Aug 29 21:43:52.476662 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 458/905] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:53.164009 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:53.165299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:53.166046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:53.166223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:53.174552 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:53.175111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:53.175289 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:53.175691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:53.175968 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:53.176752 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:53.176909 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:53.177795 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:53.177922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:53.178267 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:53.178491 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:53.179087 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:53.561906 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:53.578784 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-77bfd080-1496-4c59-9bb4-1214c4f6ab07 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1513 microversion: 2.1 time: 0.420310 Aug 29 21:43:53.580065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 448/906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:53 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1513 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:53.600833 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:53.623722 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-94bb83db-d6f7-401a-a19a-408d64cd0bc0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.465117 Aug 29 21:43:53.624788 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 459/907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:53 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:54.168835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-10b1de76-afd6-4219-a77f-b3cbc1b17e56 req-dd1c852b-cad5-4b60-914e-9406a1ce7cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44fce006-b99f-46a3-ac0c-68e2a6914659", "name": "network-vif-deleted", "tag": "02e09094-d997-4f4d-8d32-57228f28b520"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:54.180105 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-10b1de76-afd6-4219-a77f-b3cbc1b17e56 req-dd1c852b-cad5-4b60-914e-9406a1ce7cb3 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:54.180652 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-10b1de76-afd6-4219-a77f-b3cbc1b17e56 req-dd1c852b-cad5-4b60-914e-9406a1ce7cb3 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:54.181118 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-10b1de76-afd6-4219-a77f-b3cbc1b17e56 req-dd1c852b-cad5-4b60-914e-9406a1ce7cb3 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:54.196798 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-10b1de76-afd6-4219-a77f-b3cbc1b17e56 req-dd1c852b-cad5-4b60-914e-9406a1ce7cb3 service nova] Creating event network-vif-deleted:02e09094-d997-4f4d-8d32-57228f28b520 for instance 44fce006-b99f-46a3-ac0c-68e2a6914659 on hv-cinder-85426 Aug 29 21:43:54.202668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-10b1de76-afd6-4219-a77f-b3cbc1b17e56 req-dd1c852b-cad5-4b60-914e-9406a1ce7cb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038099 Aug 29 21:43:54.203326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 449/908] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:54.651111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:54.651838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:54.661879 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:54.662469 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:54.662889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:54.663617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:54.664079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:54.664509 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:54.685438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:54.686290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:54.693054 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:54.693581 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:54.694037 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:54.694816 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:54.695353 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:54.695979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:54.819628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:54.837464 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-25004c74-7e4e-4dbc-bfdd-7271e83df60f tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 200 len: 1471 microversion: 2.1 time: 0.156382 Aug 29 21:43:54.838503 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 450/909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:54 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:54.925425 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:54.939629 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-953af388-44d2-49de-9f46-953712b63f00 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.291267 Aug 29 21:43:54.940872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 460/910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:54 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:55.873687 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:55.874469 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 44fce006-b99f-46a3-ac0c-68e2a6914659] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:55.882614 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:55.883375 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:55.883812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:55.884524 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:55.885013 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:55.885435 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:55.900718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] HTTP exception thrown: Instance 44fce006-b99f-46a3-ac0c-68e2a6914659 could not be found. Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Request method failure captured: Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 HTTP/1.1 Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTKokYC3L8TesIfztsb8YiFSMHYdc75KSghKr9YYejqYTDahRNR9oL4VXeW8nzShBy3_genfeKerQm7-WQtauZPJqLJfg8i-aaq85Id7Q7kcaTRK4vXbTaMjrlvbSvHDJ4lzuFssl-6edhzLgzl3IGAf6nJGfZNu1ygH2nLs6G34e34 Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: d05e27bd70e64afbbc58379e64826217 Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1166079576 Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:43:55.902392 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d05e27bd70e64afbbc58379e64826217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d05e27bd70e64afbbc58379e64826217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d05e27bd70e64afbbc58379e64826217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d05e27bd70e64afbbc58379e64826217", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesSnapshotTestJSON-1166079576 Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: d05e27bd70e64afbbc58379e64826217 Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1166079576 Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesSnapshotTestJSON-1166079576-project Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: eb53ae825eea452d9d456233ac2af43c Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesSnapshotTestJSON-1166079576-project Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 44fce006-b99f-46a3-ac0c-68e2a6914659 could not be found. Aug 29 21:43:55.904155 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '44fce006-b99f-46a3-ac0c-68e2a6914659'} Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44fce006-b99f-46a3-ac0c-68e2a6914659 could not be found. Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:43:55.906476 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44fce006-b99f-46a3-ac0c-68e2a6914659 could not be found. Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44fce006-b99f-46a3-ac0c-68e2a6914659 could not be found. Aug 29 21:43:55.908050 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:43:55.909786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Returning 404 to user: Instance 44fce006-b99f-46a3-ac0c-68e2a6914659 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:43:55.909786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4afd9a82-6f92-4da6-8955-0f168e1b973b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659" status: 404 len: 111 microversion: 2.1 time: 0.034590 Aug 29 21:43:55.909786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 451/911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:55 2022] GET /compute/v2.1/servers/44fce006-b99f-46a3-ac0c-68e2a6914659 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:43:55.968349 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:55.969188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:55.976183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:55.976710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:55.977148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:55.977854 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:55.978319 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:55.978749 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:56.136138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:56.146746 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-70fd4aa3-ad85-4057-b536-ab1cd3e2bb7b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.183367 Aug 29 21:43:56.147972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 461/912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:55 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:57.176854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:57.177961 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:57.186190 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:57.186741 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:57.187115 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:57.187818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:57.188273 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:57.188774 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:57.365746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:57.376361 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-48fd96be-d2b5-4ac5-b70d-06c116308f1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.204910 Aug 29 21:43:57.377677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 452/913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:57 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:58.402755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:58.403452 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:58.415807 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:58.416664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:58.417431 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:58.418587 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:58.419255 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:58.420045 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:58.593891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:58.604995 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-70777641-8c19-4aed-b9ce-73f47f556b87 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.205864 Aug 29 21:43:58.605780 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 462/914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:58 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:59.627353 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:59.628063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:59.636720 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:59.637222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:59.637662 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:59.638374 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:59.638869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:59.639300 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:59.821609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:59.830722 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-48bd2150-ecaa-4919-988f-5560215c34ba tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.207288 Aug 29 21:43:59.831318 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 453/915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:59 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:00.863521 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:00.864133 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:00.876098 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:00.877211 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:00.878226 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:00.879534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:00.880466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:00.881247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:01.081850 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:01.244087 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:01.252828 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-38f34900-a8b0-4a97-b026-8462d102e2c6 req-564930ca-a4db-45d8-93a1-80ffa0d9522f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abd7bcf-c166-4f1e-bb3b-094b5b189a9b", "name": "network-vif-plugged", "status": "completed", "tag": "01de6740-c3e7-4663-ae6d-d1f005bc9acc"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:01.260914 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d3044539-a922-445d-90ef-95491ba0307f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.404839 Aug 29 21:44:01.262634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 463/916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:00 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:01.264301 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-38f34900-a8b0-4a97-b026-8462d102e2c6 req-564930ca-a4db-45d8-93a1-80ffa0d9522f service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:01.265056 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-38f34900-a8b0-4a97-b026-8462d102e2c6 req-564930ca-a4db-45d8-93a1-80ffa0d9522f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:01.265754 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-38f34900-a8b0-4a97-b026-8462d102e2c6 req-564930ca-a4db-45d8-93a1-80ffa0d9522f service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:01.278321 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-38f34900-a8b0-4a97-b026-8462d102e2c6 req-564930ca-a4db-45d8-93a1-80ffa0d9522f service nova] Creating event network-vif-plugged:01de6740-c3e7-4663-ae6d-d1f005bc9acc for instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b on hv-cinder-85426 Aug 29 21:44:01.283919 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-38f34900-a8b0-4a97-b026-8462d102e2c6 req-564930ca-a4db-45d8-93a1-80ffa0d9522f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038455 Aug 29 21:44:01.285029 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 454/917] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:02.299490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:02.300332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:02.310740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:02.311602 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:02.312364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:02.313652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:02.314466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:02.315221 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:02.500178 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:02.510341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1e2affce-8df5-4fd4-a652-cee0e2626010 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.216916 Aug 29 21:44:02.510900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 464/918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:02 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:03.533691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:03.534749 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:03.542313 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:03.543065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:03.543669 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:03.544750 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:03.545938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:03.546710 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:03.573733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:03.953115 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:03.967086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7f73e668-ebef-4805-8567-80c758f2be19 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.438558 Aug 29 21:44:03.968089 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 455/919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:03 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:05.002022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:05.002740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:05.009901 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:05.010746 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:05.011264 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:05.012031 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:05.012530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:05.013102 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:05.244524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:05.259035 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-113a9940-c4ad-4a07-b918-24e3da8ae5f0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1358 microversion: 2.1 time: 0.260630 Aug 29 21:44:05.260030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 465/920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:04 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:06.098979 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-598917209", "imageRef": "a0a68f6a-18e2-4ba3-866e-e666ac99a7a7", "flavorRef": "452", "networks": [{"uuid": "232cf447-28fa-40a6-80b9-0c467edd0554"}]}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:06.172051 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.network.neutron [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] validate_networks() for [('232cf447-28fa-40a6-80b9-0c467edd0554', None, None, None, None, None)] {{(pid=127217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:44:06.291688 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:06.293079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:06.304377 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.305170 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.305624 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.306355 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.306828 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.307267 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.603005 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:06.617887 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-d20b61cb-27af-4824-93de-8dcef0b76d1a tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1547 microversion: 2.1 time: 0.332767 Aug 29 21:44:06.618926 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 466/921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:06 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1547 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:06.655020 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:06.655915 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:06.663589 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.664439 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.665143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.666155 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.667043 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.667826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.688746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Flavor limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:44:06.689673 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Image limits 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:44:06.690693 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Flavor pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:44:06.691632 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Image pref 0:0:0 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:44:06.692528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.virt.hardware [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:44:06.704474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.704991 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.705435 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.706158 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.706611 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.707034 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.725229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Getting quotas for project d05e27bd70e64afbbc58379e64826217. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:44:06.730932 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.quota [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Getting quotas for user eb53ae825eea452d9d456233ac2af43c and project d05e27bd70e64afbbc58379e64826217. Resources: {'cores', 'instances', 'ram'} {{(pid=127217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:44:06.745293 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Going to run 1 instances... {{(pid=127217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:44:06.749229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0a68f6a-18e2-4ba3-866e-e666ac99a7a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:44:06.804270 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c10bef65-aeac-4a1b-83c7-6f7653d2212b tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710379 Aug 29 21:44:06.805315 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 456/922] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 21:44:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:44:06.825835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8a7744dc-0833-4556-89b6-f41224a02d26 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:06.827881 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8a7744dc-0833-4556-89b6-f41224a02d26 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:06.859373 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:06.872021 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a2079635-10cd-4024-9687-3cd73636fd1d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1547 microversion: 2.1 time: 0.223632 Aug 29 21:44:06.873836 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 467/923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:06 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1547 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:06.901784 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:06.906847 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:06.907925 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Searching by: {'deleted': False, 'project_id': '84b949156c47430fae4f516e4c6d80ba'} {{(pid=127216) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 21:44:06.915011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.915506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.915930 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.916679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:06.917130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:06.917550 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:06.922129 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8a7744dc-0833-4556-89b6-f41224a02d26 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:06.935977 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8a7744dc-0833-4556-89b6-f41224a02d26 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1218 microversion: 2.1 time: 0.116718 Aug 29 21:44:06.937746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 457/924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:06 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:07.048097 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.multi_cell_list [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127216) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 21:44:07.188565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-b6a05918-3629-4486-8b5f-5dee6c916d8c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.297937 Aug 29 21:44:07.189549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 468/925] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 21:44:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:07.204620 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:07.205995 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:07.213619 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:07.214244 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:07.214823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:07.215704 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:07.216796 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:07.217383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:07.412668 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:07.424092 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c4622aec-26c5-4b06-98d1-c75ee1fc7638 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1547 microversion: 2.1 time: 0.224507 Aug 29 21:44:07.424857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 458/926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:07 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1547 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:07.968957 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:07.969759 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:07.972174 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:07.982154 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:07.983111 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:07.983866 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:07.984904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:07.985456 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:07.985924 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:08.066414 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:08.074705 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-02d5136d-339c-4e69-b29d-d801e088d3bc tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1270 microversion: 2.1 time: 0.109799 Aug 29 21:44:08.075291 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 469/927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:07 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:09.098598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:09.100211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:09.106010 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:09.123351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:09.124172 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:09.124843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:09.126222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:09.126904 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:09.128243 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:09.241745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df47d675-a03f-4161-b68f-dca6c81c63cf"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:09.247081 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:09.259450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:09.260369 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:09.261145 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:09.262420 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:09.263313 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:09.264112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:09.410343 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:09.419415 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-5478c75c-d987-4fa1-96b8-839ecaa781a3 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.326635 Aug 29 21:44:09.433028 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 459/928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:09 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:09.591905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7f6a7e30-1209-46d7-aaad-659b3efeee92 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355591 Aug 29 21:44:09.592540 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 470/929] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:44:09 2022] POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:44:09.908176 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-939e4092-98db-453d-bfa2-cc4688ae002d req-0cec6881-5991-4c4c-b293-75ad09360f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09612246-2304-403b-9bed-bd375c4db09a", "tag": "9018d45a-98ba-45ba-94fb-ba5182cf1c12"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:09.935685 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-939e4092-98db-453d-bfa2-cc4688ae002d req-0cec6881-5991-4c4c-b293-75ad09360f59 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:09.938153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-939e4092-98db-453d-bfa2-cc4688ae002d req-0cec6881-5991-4c4c-b293-75ad09360f59 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:09.938621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-939e4092-98db-453d-bfa2-cc4688ae002d req-0cec6881-5991-4c4c-b293-75ad09360f59 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:09.952606 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-939e4092-98db-453d-bfa2-cc4688ae002d req-0cec6881-5991-4c4c-b293-75ad09360f59 service nova] Creating event network-changed:9018d45a-98ba-45ba-94fb-ba5182cf1c12 for instance 09612246-2304-403b-9bed-bd375c4db09a on hv-cinder-85426 Aug 29 21:44:09.957888 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-939e4092-98db-453d-bfa2-cc4688ae002d req-0cec6881-5991-4c4c-b293-75ad09360f59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057571 Aug 29 21:44:09.958495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 460/930] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:44:10.445597 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:10.446370 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:10.455145 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:10.455848 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:10.456398 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:10.457279 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:10.457836 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:10.458356 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:10.802139 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:10.813365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-c4b3c12f-6c60-47b2-96d1-e8f92c85130e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.373934 Aug 29 21:44:10.813947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 471/931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:10 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:11.838541 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:11.839877 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:11.850518 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:11.851556 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:11.852215 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:11.853203 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:11.853826 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:11.854520 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:12.078867 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:12.089408 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-26800331-a70d-4f56-89f0-685b0efc60c6 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.256883 Aug 29 21:44:12.089992 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 461/932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:11 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:13.111304 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:13.112222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:13.122001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:13.123013 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:13.123459 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:13.124710 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:13.125112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:13.125604 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:13.318738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:13.328244 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-91bb9b6a-848f-4603-be0a-39d5d7b10c5d tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.221198 Aug 29 21:44:13.328944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 472/933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:13 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:14.350782 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:14.351535 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:14.358299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:14.358784 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:14.359233 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:14.359929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:14.360387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:14.360843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:14.519315 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:14.529612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-94c7e643-dd73-4ea0-ad40-77a73a95085c tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.182304 Aug 29 21:44:14.530182 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 462/934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:14 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:15.554119 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:15.556136 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:15.564881 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:15.565716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:15.566450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:15.567663 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:15.568436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:15.569182 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:15.741969 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:15.755326 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-db9106e1-014f-4c93-a1b1-360951077bac tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.207560 Aug 29 21:44:15.756534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 473/935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:15 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:16.290284 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:16.290924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:16.298037 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:16.298714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:16.299334 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:16.300314 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:16.300823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:16.301429 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:16.454169 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:16.467768 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-d061bb46-acd5-49e3-82b9-5401be17a77c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1593 microversion: 2.1 time: 0.181535 Aug 29 21:44:16.468854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 463/936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:16 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1593 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:16.778541 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:16.780010 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:16.789592 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:16.790095 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:16.790844 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:16.791752 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:16.792256 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:16.792718 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:16.958450 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell0:SELECT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:17.035112 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:17.047442 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dc29e58e-8fa3-4153-8907-107b95bccb20 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.272464 Aug 29 21:44:17.048280 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 474/937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:16 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:17.367388 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-0876ab10-d784-4a2b-82b5-7d49ad8c700c req-3d4ebeb3-2972-422b-ac9f-6180ccd33df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09612246-2304-403b-9bed-bd375c4db09a", "name": "network-vif-plugged", "status": "completed", "tag": "9018d45a-98ba-45ba-94fb-ba5182cf1c12"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:17.380110 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:17.382193 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell0:SELECT=8 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:17.391738 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-0876ab10-d784-4a2b-82b5-7d49ad8c700c req-3d4ebeb3-2972-422b-ac9f-6180ccd33df6 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:17.392537 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-0876ab10-d784-4a2b-82b5-7d49ad8c700c req-3d4ebeb3-2972-422b-ac9f-6180ccd33df6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:17.393292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-0876ab10-d784-4a2b-82b5-7d49ad8c700c req-3d4ebeb3-2972-422b-ac9f-6180ccd33df6 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:17.415087 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-0876ab10-d784-4a2b-82b5-7d49ad8c700c req-3d4ebeb3-2972-422b-ac9f-6180ccd33df6 service nova] Creating event network-vif-plugged:9018d45a-98ba-45ba-94fb-ba5182cf1c12 for instance 09612246-2304-403b-9bed-bd375c4db09a on hv-cinder-85426 Aug 29 21:44:17.424224 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-0876ab10-d784-4a2b-82b5-7d49ad8c700c req-3d4ebeb3-2972-422b-ac9f-6180ccd33df6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065841 Aug 29 21:44:17.425650 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 464/938] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:44:18.084342 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:18.085433 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:18.094465 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:18.095761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:18.096530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:18.097786 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:18.098429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:18.099126 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:18.327483 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:18.340078 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9bc47b80-4ca8-4d90-985d-a79ee40f498e tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1318 microversion: 2.1 time: 0.260531 Aug 29 21:44:18.341091 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 475/939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:18 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:18.698340 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-e83c7511-2e83-4eb8-9cd5-cd21787114ad req-7bd5806b-14c4-4b58-ba92-01887ea67222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abd7bcf-c166-4f1e-bb3b-094b5b189a9b", "tag": "01de6740-c3e7-4663-ae6d-d1f005bc9acc"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:18.708625 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-e83c7511-2e83-4eb8-9cd5-cd21787114ad req-7bd5806b-14c4-4b58-ba92-01887ea67222 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:18.709381 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-e83c7511-2e83-4eb8-9cd5-cd21787114ad req-7bd5806b-14c4-4b58-ba92-01887ea67222 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:18.709531 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-e83c7511-2e83-4eb8-9cd5-cd21787114ad req-7bd5806b-14c4-4b58-ba92-01887ea67222 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:18.723056 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-e83c7511-2e83-4eb8-9cd5-cd21787114ad req-7bd5806b-14c4-4b58-ba92-01887ea67222 service nova] Creating event network-changed:01de6740-c3e7-4663-ae6d-d1f005bc9acc for instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b on hv-cinder-85426 Aug 29 21:44:18.728381 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-e83c7511-2e83-4eb8-9cd5-cd21787114ad req-7bd5806b-14c4-4b58-ba92-01887ea67222 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034367 Aug 29 21:44:18.729471 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 465/940] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:19.371405 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:19.372372 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:19.381381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:19.382464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:19.383480 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:19.384341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:19.385216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:19.385216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:19.729357 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:19.739922 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-7cde6985-07a3-42d5-a9a1-6096bbaa2e97 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1508 microversion: 2.1 time: 0.375454 Aug 29 21:44:19.741064 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 476/941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:19 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:19.777434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db8f6460-7725-4818-bda5-5747385566bd", "device": "/dev/sdb"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:19.782123 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:19.793356 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:19.794245 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:19.795022 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:19.795901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:19.797113 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:19.798107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:20.349178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-86c6fc24-aabb-4f8a-9b5d-ae6b39961768 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "POST /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580028 Aug 29 21:44:20.351247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 466/942] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 21:44:19 2022] POST /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:44:20.496906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1121181353"}} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:20.497894 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:20.515835 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:20.516993 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:20.517761 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:20.519051 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:20.519950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:20.520679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:20.702914 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.network.security_group_api [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Adding security group 6f349097-fcc6-4020-ae5a-afa186258501 to port 01de6740-c3e7-4663-ae6d-d1f005bc9acc Aug 29 21:44:21.117424 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6c1a15d2-0890-4876-baa3-9e82d2bf6fe8 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.636438 Aug 29 21:44:21.120179 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 477/943] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:44:20 2022] POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:44:21.126533 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:21.128110 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:21.130530 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-312b6b6c-956d-4248-8497-66479de5859f req-dfec1047-3743-40d2-904f-13a959906665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abd7bcf-c166-4f1e-bb3b-094b5b189a9b", "tag": "01de6740-c3e7-4663-ae6d-d1f005bc9acc"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:21.135839 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:21.136977 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:21.137777 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:21.139169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:21.139923 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:21.140500 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:21.158945 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-312b6b6c-956d-4248-8497-66479de5859f req-dfec1047-3743-40d2-904f-13a959906665 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:21.159774 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-312b6b6c-956d-4248-8497-66479de5859f req-dfec1047-3743-40d2-904f-13a959906665 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:21.160533 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-312b6b6c-956d-4248-8497-66479de5859f req-dfec1047-3743-40d2-904f-13a959906665 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:21.185894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-312b6b6c-956d-4248-8497-66479de5859f req-dfec1047-3743-40d2-904f-13a959906665 service nova] Creating event network-changed:01de6740-c3e7-4663-ae6d-d1f005bc9acc for instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b on hv-cinder-85426 Aug 29 21:44:21.194702 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-312b6b6c-956d-4248-8497-66479de5859f req-dfec1047-3743-40d2-904f-13a959906665 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071412 Aug 29 21:44:21.196182 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 467/944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:21.436293 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:21.441743 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:21.450751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-06b2f5f9-9bfb-4982-a385-027d78a0c0e5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1759 microversion: 2.1 time: 0.327762 Aug 29 21:44:21.451506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 478/945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:21 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1759 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:29.144219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:29.145125 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:29.148508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:44:29.148728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Mon Aug 29 21:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc (ip 10.222.0.20) !!! Aug 29 21:44:29.149479 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-f3d2ca23-a967-49a1-9d97-b758a4c5dade req-014ff832-18c0-4bdd-84dd-fdfa8fa41d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609a9478-ab5d-4c53-9efa-77d661126ebc", "tag": "d06909f2-99eb-4f38-b138-f0635d567f6b"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:29.163223 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f3d2ca23-a967-49a1-9d97-b758a4c5dade req-014ff832-18c0-4bdd-84dd-fdfa8fa41d39 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:29.163849 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f3d2ca23-a967-49a1-9d97-b758a4c5dade req-014ff832-18c0-4bdd-84dd-fdfa8fa41d39 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:29.164611 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-f3d2ca23-a967-49a1-9d97-b758a4c5dade req-014ff832-18c0-4bdd-84dd-fdfa8fa41d39 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:29.174791 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:29.175633 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:29.176081 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:29.176857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:29.177935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:29.178388 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:29.180861 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-f3d2ca23-a967-49a1-9d97-b758a4c5dade req-014ff832-18c0-4bdd-84dd-fdfa8fa41d39 service nova] Creating event network-changed:d06909f2-99eb-4f38-b138-f0635d567f6b for instance 609a9478-ab5d-4c53-9efa-77d661126ebc on hv-cinder-85426 Aug 29 21:44:29.187075 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-f3d2ca23-a967-49a1-9d97-b758a4c5dade req-014ff832-18c0-4bdd-84dd-fdfa8fa41d39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043531 Aug 29 21:44:29.188318 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 479/946] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:29.217413 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:44:29.323998 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-226f9b76-3ac0-4716-a9e1-986748f7aea0 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "DELETE /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 204 len: 0 microversion: 2.1 time: 0.183896 Aug 29 21:44:29.324572 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 468/947] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:44:29 2022] DELETE /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:44:29.334201 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:29.335650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:29.343429 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:29.344204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:29.345314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:29.345528 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:29.345896 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:29.346332 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:29.527683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:29.540003 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0f7acc4b-18ea-4164-83e0-64874fd952b3 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1576 microversion: 2.1 time: 0.209961 Aug 29 21:44:29.540623 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 480/948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:29 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:30.568442 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:30.569217 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:30.576733 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:30.577242 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:30.577672 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:30.578389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:30.579131 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:30.581623 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:30.752086 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:30.760391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-7b4450c5-1c17-4eee-b799-26735333db3f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1576 microversion: 2.1 time: 0.196237 Aug 29 21:44:30.761005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 469/949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:30 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:31.785603 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:31.786471 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:31.796455 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:31.797322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:31.797961 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:31.798879 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:31.799536 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:31.800099 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:31.956989 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:31.965156 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-63a1291a-254e-4001-99e5-4e56a231e884 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1576 microversion: 2.1 time: 0.185411 Aug 29 21:44:31.965733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 481/950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:31 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:32.987485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:32.988048 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:32.994489 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:32.994977 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:32.995408 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:32.996115 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:32.996563 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:32.997011 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:33.138758 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:33.148201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-bc7b2c3d-d77d-477c-9d6a-cdfc2ce8ef35 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1576 microversion: 2.1 time: 0.164620 Aug 29 21:44:33.148963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 470/951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:32 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:34.174524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:34.175129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:34.182958 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:34.183517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:34.183989 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:34.184839 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:34.185364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:34.185851 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:34.336661 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:34.345464 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cfa9d1a3-8a09-45b6-90b3-0e5bf32abfe7 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1576 microversion: 2.1 time: 0.176056 Aug 29 21:44:34.346329 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 482/952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:34 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:35.373311 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:35.374443 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:35.385639 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:35.386441 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:35.387223 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:35.388471 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:35.389329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:35.390094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:35.396189 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:35.552485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:35.561041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-67a2b6e5-e3af-4553-bcdc-2136a5e66770 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1576 microversion: 2.1 time: 0.195450 Aug 29 21:44:35.561630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 471/953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:35 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:36.225116 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-054c92d2-a2d0-4c0c-90a3-95e2bffea196 req-69e171b3-e957-4909-9344-09067483f5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609a9478-ab5d-4c53-9efa-77d661126ebc", "name": "network-vif-deleted", "tag": "d06909f2-99eb-4f38-b138-f0635d567f6b"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:36.248730 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-054c92d2-a2d0-4c0c-90a3-95e2bffea196 req-69e171b3-e957-4909-9344-09067483f5e0 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:36.249996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-054c92d2-a2d0-4c0c-90a3-95e2bffea196 req-69e171b3-e957-4909-9344-09067483f5e0 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:36.250742 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-054c92d2-a2d0-4c0c-90a3-95e2bffea196 req-69e171b3-e957-4909-9344-09067483f5e0 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:36.264053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-054c92d2-a2d0-4c0c-90a3-95e2bffea196 req-69e171b3-e957-4909-9344-09067483f5e0 service nova] Creating event network-vif-deleted:d06909f2-99eb-4f38-b138-f0635d567f6b for instance 609a9478-ab5d-4c53-9efa-77d661126ebc on hv-cinder-85426 Aug 29 21:44:36.269286 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-054c92d2-a2d0-4c0c-90a3-95e2bffea196 req-69e171b3-e957-4909-9344-09067483f5e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055853 Aug 29 21:44:36.269908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 483/954] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:44:36.585660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:36.586389 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:36.593391 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:36.594347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:36.595097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:36.596417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:36.597349 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:36.598019 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:36.648999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:36.649554 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:36.650187 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:36.650905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lazy-loading 'fault' on Instance uuid 609a9478-ab5d-4c53-9efa-77d661126ebc {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:44:36.713482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:36.728746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8bd020a9-df67-407a-8501-16074265dd2c tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 200 len: 1230 microversion: 2.1 time: 0.147725 Aug 29 21:44:36.730069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 472/955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:36 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 1230 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:37.755266 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:37.756048 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 609a9478-ab5d-4c53-9efa-77d661126ebc] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:37.764142 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:37.764671 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:37.765113 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:37.765811 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:37.766297 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:37.766718 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:37.785144 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] HTTP exception thrown: Instance 609a9478-ab5d-4c53-9efa-77d661126ebc could not be found. Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Request method failure captured: Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc HTTP/1.1 Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTEuu3Pr_VzTsNG6hX3iKJqud0iKEa6TThjtjf3dvah6wO7fKjvOTKDYSSMC2ln2rZNMuVFnW0wzNg-fbu4eZtJlwSnmmbMZoIjGsbXSsiNwSdIOuQOd1YmQ8dLyd7I0IlBQYbBzusLQsxPcJQXUnB4X-qvlGRIW4w98h5AgZTSzZm0 Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:44:37.788159 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98d4703c6737454291724a5ad15c9cbb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: d882c87d5de7497b822ec7b1798d2008 Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 609a9478-ab5d-4c53-9efa-77d661126ebc could not be found. Aug 29 21:44:37.789885 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '609a9478-ab5d-4c53-9efa-77d661126ebc'} Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609a9478-ab5d-4c53-9efa-77d661126ebc could not be found. Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:44:37.790878 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609a9478-ab5d-4c53-9efa-77d661126ebc could not be found. Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609a9478-ab5d-4c53-9efa-77d661126ebc could not be found. Aug 29 21:44:37.792740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:37.795137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Returning 404 to user: Instance 609a9478-ab5d-4c53-9efa-77d661126ebc could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:44:37.795137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f3bf5f92-91db-495e-b962-0f9c6d9b9806 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc" status: 404 len: 111 microversion: 2.1 time: 0.038770 Aug 29 21:44:37.795137 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 484/956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:37 2022] GET /compute/v2.1/servers/609a9478-ab5d-4c53-9efa-77d661126ebc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:44:40.195575 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:40.196466 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:40.200969 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:40.209781 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:40.210730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:40.211513 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:40.212821 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:40.213646 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:40.214430 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:40.349174 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lazy-loading 'services' on Instance uuid 09612246-2304-403b-9bed-bd375c4db09a {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:44:40.435594 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-63ac4cd3-e126-435f-84cc-17e1b1ed0a71 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a/os-volume_attachments/db8f6460-7725-4818-bda5-5747385566bd" status: 202 len: 0 microversion: 2.1 time: 0.247036 Aug 29 21:44:40.436386 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 473/957] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:44:40 2022] DELETE /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a/os-volume_attachments/db8f6460-7725-4818-bda5-5747385566bd => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:44:41.406064 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:41.407554 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:41.410479 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=32 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:41.412844 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-a6d3485f-efb2-4dbf-99c5-d2a2e909019c req-dab3335e-43f3-449f-9c63-5eaef014c032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe03072e-8d13-4a8d-82f3-a40688588269", "tag": "acaaea14-ae8c-4840-97ee-5906201e9e88"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:41.416211 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.416747 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.417365 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.418349 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.419392 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.420049 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.425785 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a6d3485f-efb2-4dbf-99c5-d2a2e909019c req-dab3335e-43f3-449f-9c63-5eaef014c032 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.426654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a6d3485f-efb2-4dbf-99c5-d2a2e909019c req-dab3335e-43f3-449f-9c63-5eaef014c032 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.427419 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a6d3485f-efb2-4dbf-99c5-d2a2e909019c req-dab3335e-43f3-449f-9c63-5eaef014c032 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.450417 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-a6d3485f-efb2-4dbf-99c5-d2a2e909019c req-dab3335e-43f3-449f-9c63-5eaef014c032 service nova] Creating event network-changed:acaaea14-ae8c-4840-97ee-5906201e9e88 for instance fe03072e-8d13-4a8d-82f3-a40688588269 on hv-cinder-85426 Aug 29 21:44:41.453164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:44:41.460448 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-a6d3485f-efb2-4dbf-99c5-d2a2e909019c req-dab3335e-43f3-449f-9c63-5eaef014c032 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054318 Aug 29 21:44:41.461924 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 474/958] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:41.584354 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cfd1ef5a-e7d3-4aa1-a819-444859661aba tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 204 len: 0 microversion: 2.1 time: 0.183929 Aug 29 21:44:41.588773 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 485/959] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:44:41 2022] DELETE /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:44:41.597477 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:41.598677 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:41.605534 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.606317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.607475 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.608184 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.608666 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.609549 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.618833 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:41.619711 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:41.626711 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.627514 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.628271 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.629205 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.629912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.630505 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.663204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:44:41.790344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dc329dff-bab7-49d6-a6fb-ec09b6774fdb tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 204 len: 0 microversion: 2.1 time: 0.174974 Aug 29 21:44:41.791505 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 486/960] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:44:41 2022] DELETE /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:44:41.803204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:41.804108 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:41.811974 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.812622 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.813082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.814509 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:41.815328 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:41.815849 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:41.897745 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:41.914860 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-de944a66-b128-4673-b1a4-20146a0d8c1d tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1575 microversion: 2.1 time: 0.323431 Aug 29 21:44:41.915509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 475/961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:41 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1575 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:42.014216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:42.023195 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-1247e840-7ccf-4140-9009-362b168d42da tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1514 microversion: 2.1 time: 0.225314 Aug 29 21:44:42.024082 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 487/962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:41 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:42.938645 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:42.939317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:42.946044 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:42.946527 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:42.946960 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:42.947646 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:42.948094 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:42.948515 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:43.045938 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:43.046716 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:43.054212 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:43.054794 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:43.055298 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:43.056071 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:43.056635 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:43.057165 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:43.100248 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:43.109016 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-90a81071-7485-4035-b860-c732e2e28202 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1575 microversion: 2.1 time: 0.174395 Aug 29 21:44:43.109737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 476/963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:42 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:43.223378 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:43.231868 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-91af20ae-af22-450f-8795-f2a642c05f61 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1514 microversion: 2.1 time: 0.190053 Aug 29 21:44:43.232454 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 488/964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:43 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:44.132326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:44.133609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:44.145180 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:44.145683 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:44.146128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:44.146899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:44.147451 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:44.147881 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:44.253135 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:44.254079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:44.261120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:44.261609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:44.262041 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:44.263357 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:44.263815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:44.264233 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:44.511904 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:44.521961 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-76809999-88d6-4ba6-9c55-23918f47f950 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1457 microversion: 2.1 time: 0.393654 Aug 29 21:44:44.522647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 477/965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:44 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1457 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:44.613738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb53ae825eea452d9d456233ac2af43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05e27bd70e64afbbc58379e64826217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:44.623830 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-bce2d922-38c3-49fe-ad20-fcc21963c834 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 200 len: 1514 microversion: 2.1 time: 0.374532 Aug 29 21:44:44.627286 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 489/966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:44 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:44.736837 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-a3463d6b-ef98-4e6b-b8f9-9a93d0a6363b req-bd82266c-310d-4fe5-88f5-6608786ee5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09612246-2304-403b-9bed-bd375c4db09a", "name": "network-vif-deleted", "tag": "9018d45a-98ba-45ba-94fb-ba5182cf1c12"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:44.756379 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a3463d6b-ef98-4e6b-b8f9-9a93d0a6363b req-bd82266c-310d-4fe5-88f5-6608786ee5f8 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:44.756878 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a3463d6b-ef98-4e6b-b8f9-9a93d0a6363b req-bd82266c-310d-4fe5-88f5-6608786ee5f8 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:44.757382 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-a3463d6b-ef98-4e6b-b8f9-9a93d0a6363b req-bd82266c-310d-4fe5-88f5-6608786ee5f8 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:44.781250 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-a3463d6b-ef98-4e6b-b8f9-9a93d0a6363b req-bd82266c-310d-4fe5-88f5-6608786ee5f8 service nova] Creating event network-vif-deleted:9018d45a-98ba-45ba-94fb-ba5182cf1c12 for instance 09612246-2304-403b-9bed-bd375c4db09a on hv-cinder-85426 Aug 29 21:44:44.787315 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-a3463d6b-ef98-4e6b-b8f9-9a93d0a6363b req-bd82266c-310d-4fe5-88f5-6608786ee5f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057231 Aug 29 21:44:44.787912 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 478/967] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:45.545785 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:45.546475 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:45.554157 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:45.554689 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:45.555153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:45.555947 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:45.556407 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:45.556856 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:45.605904 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:45.606399 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:45.606889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:45.607336 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lazy-loading 'fault' on Instance uuid fe03072e-8d13-4a8d-82f3-a40688588269 {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:44:45.651728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:45.652695 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] [instance: 09612246-2304-403b-9bed-bd375c4db09a] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:45.661705 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:45.662229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:45.662885 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:45.663601 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:45.665199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:45.665383 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:45.667305 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd882c87d5de7497b822ec7b1798d2008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d4703c6737454291724a5ad15c9cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:45.680800 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6c043320-7fb9-4b26-945e-187d33964d19 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 200 len: 1230 microversion: 2.1 time: 0.138757 Aug 29 21:44:45.681741 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 490/968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:45 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 1230 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:45.684432 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] HTTP exception thrown: Instance 09612246-2304-403b-9bed-bd375c4db09a could not be found. Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Request method failure captured: Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a HTTP/1.1 Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTKokYC3L8TesIfztsb8YiFSMHYdc75KSghKr9YYejqYTDahRNR9oL4VXeW8nzShBy3_genfeKerQm7-WQtauZPJqLJfg8i-aaq85Id7Q7kcaTRK4vXbTaMjrlvbSvHDJ4lzuFssl-6edhzLgzl3IGAf6nJGfZNu1ygH2nLs6G34e34 Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: d05e27bd70e64afbbc58379e64826217 Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1166079576 Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:44:45.686711 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d05e27bd70e64afbbc58379e64826217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d05e27bd70e64afbbc58379e64826217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d05e27bd70e64afbbc58379e64826217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d05e27bd70e64afbbc58379e64826217", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-VolumesSnapshotTestJSON-1166079576 Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: d05e27bd70e64afbbc58379e64826217 Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1166079576 Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-VolumesSnapshotTestJSON-1166079576-project Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: eb53ae825eea452d9d456233ac2af43c Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-VolumesSnapshotTestJSON-1166079576-project Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 09612246-2304-403b-9bed-bd375c4db09a could not be found. Aug 29 21:44:45.689328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '09612246-2304-403b-9bed-bd375c4db09a'} Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09612246-2304-403b-9bed-bd375c4db09a could not be found. Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:44:45.691117 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09612246-2304-403b-9bed-bd375c4db09a could not be found. Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09612246-2304-403b-9bed-bd375c4db09a could not be found. Aug 29 21:44:45.692732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:45.693990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] Returning 404 to user: Instance 09612246-2304-403b-9bed-bd375c4db09a could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:44:45.693990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-8b8ee617-8431-4574-b13e-0e61abdbaa36 tempest-VolumesSnapshotTestJSON-1166079576 tempest-VolumesSnapshotTestJSON-1166079576-project] 10.222.0.20 "GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a" status: 404 len: 111 microversion: 2.1 time: 0.043319 Aug 29 21:44:45.693990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 479/969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:45 2022] GET /compute/v2.1/servers/09612246-2304-403b-9bed-bd375c4db09a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:44:46.713234 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:46.714084 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: fe03072e-8d13-4a8d-82f3-a40688588269] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:46.721242 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:46.721738 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:46.722184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:46.722892 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:46.723353 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:46.723779 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:46.740961 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] HTTP exception thrown: Instance fe03072e-8d13-4a8d-82f3-a40688588269 could not be found. Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Request method failure captured: Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 HTTP/1.1 Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTEuu3Pr_VzTsNG6hX3iKJqud0iKEa6TThjtjf3dvah6wO7fKjvOTKDYSSMC2ln2rZNMuVFnW0wzNg-fbu4eZtJlwSnmmbMZoIjGsbXSsiNwSdIOuQOd1YmQ8dLyd7I0IlBQYbBzusLQsxPcJQXUnB4X-qvlGRIW4w98h5AgZTSzZm0 Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:44:46.742620 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98d4703c6737454291724a5ad15c9cbb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: d882c87d5de7497b822ec7b1798d2008 Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance fe03072e-8d13-4a8d-82f3-a40688588269 could not be found. Aug 29 21:44:46.745549 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': 'fe03072e-8d13-4a8d-82f3-a40688588269'} Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe03072e-8d13-4a8d-82f3-a40688588269 could not be found. Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:44:46.747196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe03072e-8d13-4a8d-82f3-a40688588269 could not be found. Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe03072e-8d13-4a8d-82f3-a40688588269 could not be found. Aug 29 21:44:46.750040 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:46.753146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Returning 404 to user: Instance fe03072e-8d13-4a8d-82f3-a40688588269 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:44:46.753146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a992c87f-99bc-4193-a919-fa2d2d48725f tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269" status: 404 len: 111 microversion: 2.1 time: 0.034885 Aug 29 21:44:46.753146 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 491/970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:46 2022] GET /compute/v2.1/servers/fe03072e-8d13-4a8d-82f3-a40688588269 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:44:46.803991 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-783d5c16-81f5-45d3-b8fb-5bd905059281 req-51cb0fe6-30f7-4489-9a8f-0a492c70cc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe03072e-8d13-4a8d-82f3-a40688588269", "name": "network-vif-deleted", "tag": "acaaea14-ae8c-4840-97ee-5906201e9e88"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:46.815256 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-783d5c16-81f5-45d3-b8fb-5bd905059281 req-51cb0fe6-30f7-4489-9a8f-0a492c70cc75 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:46.815829 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-783d5c16-81f5-45d3-b8fb-5bd905059281 req-51cb0fe6-30f7-4489-9a8f-0a492c70cc75 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:46.816828 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-783d5c16-81f5-45d3-b8fb-5bd905059281 req-51cb0fe6-30f7-4489-9a8f-0a492c70cc75 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:46.832198 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-783d5c16-81f5-45d3-b8fb-5bd905059281 req-51cb0fe6-30f7-4489-9a8f-0a492c70cc75 service nova] Creating event network-vif-deleted:acaaea14-ae8c-4840-97ee-5906201e9e88 for instance fe03072e-8d13-4a8d-82f3-a40688588269 on hv-cinder-85426 Aug 29 21:44:46.838398 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-783d5c16-81f5-45d3-b8fb-5bd905059281 req-51cb0fe6-30f7-4489-9a8f-0a492c70cc75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037745 Aug 29 21:44:46.842129 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 480/971] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:47.305368 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:47.306617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:47.323011 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:47.323565 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:47.324634 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:47.327263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:47.328945 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:47.329740 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:47.358079 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] HTTP exception thrown: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Request method failure captured: Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: DELETE /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 HTTP/1.1 Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTEuu3Pr_VzTsNG6hX3iKJqud0iKEa6TThjtjf3dvah6wO7fKjvOTKDYSSMC2ln2rZNMuVFnW0wzNg-fbu4eZtJlwSnmmbMZoIjGsbXSsiNwSdIOuQOd1YmQ8dLyd7I0IlBQYbBzusLQsxPcJQXUnB4X-qvlGRIW4w98h5AgZTSzZm0 Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:44:47.361164 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98d4703c6737454291724a5ad15c9cbb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: d882c87d5de7497b822ec7b1798d2008 Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.363222 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8'} Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:44:47.364466 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.366148 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.367490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Returning 404 to user: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:44:47.367490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-0dc30f74-d61f-4af7-b46e-16831fe0e000 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 404 len: 111 microversion: 2.1 time: 0.061948 Aug 29 21:44:47.367490 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 492/972] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:44:47 2022] DELETE /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:44:47.374844 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:47.375560 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] [instance: 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:47.383241 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:47.383675 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:47.384178 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:47.385031 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:47.385776 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:47.386393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:47.407482 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] HTTP exception thrown: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Request method failure captured: Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 HTTP/1.1 Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTEuu3Pr_VzTsNG6hX3iKJqud0iKEa6TThjtjf3dvah6wO7fKjvOTKDYSSMC2ln2rZNMuVFnW0wzNg-fbu4eZtJlwSnmmbMZoIjGsbXSsiNwSdIOuQOd1YmQ8dLyd7I0IlBQYbBzusLQsxPcJQXUnB4X-qvlGRIW4w98h5AgZTSzZm0 Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:44:47.410757 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d4703c6737454291724a5ad15c9cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98d4703c6737454291724a5ad15c9cbb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 98d4703c6737454291724a5ad15c9cbb Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1006292317 Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: d882c87d5de7497b822ec7b1798d2008 Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-TestVolumeBootPattern-1006292317-project Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.412493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8'} Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:44:47.413567 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. Aug 29 21:44:47.417526 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:44:47.419260 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Returning 404 to user: Instance 8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:44:47.419260 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-843312b4-30ab-4de5-b463-420cd1a9f9ff tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8" status: 404 len: 111 microversion: 2.1 time: 0.042763 Aug 29 21:44:47.419260 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 481/973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:47 2022] GET /compute/v2.1/servers/8cd06f7a-a9ed-4bbc-9cb1-16663d80dee8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:44:50.900679 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9bb24433-e3cb-47a5-beca-c1876a65b1f4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] Calling method '.version_select at 0x7f5402b919d0>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:50.931428 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9bb24433-e3cb-47a5-beca-c1876a65b1f4 tempest-TestVolumeBootPattern-1006292317 tempest-TestVolumeBootPattern-1006292317-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-796113926" status: 202 len: 0 microversion: 2.1 time: 0.034597 Aug 29 21:44:50.935457 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 493/974] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 21:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-796113926 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:44:53.453705 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:44:53.456141 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:53.465153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:53.469082 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:53.469818 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:53.470738 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:53.471263 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:53.471800 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:53.573996 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-29c62597-04a8-4ff3-b486-e67f057be6b4 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.125288 Aug 29 21:44:53.574894 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 482/975] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:44:53 2022] POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:44:53.583908 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:53.585216 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:53.593613 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:53.594499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:53.595208 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:53.596096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:53.596485 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:53.596939 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:53.951411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:53.961141 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cc55f749-51a3-4597-a4d4-1fbd8e604cbf tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1751 microversion: 2.1 time: 0.381946 Aug 29 21:44:53.961871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 494/976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:53 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1751 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:54.986905 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:54.987915 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:54.994858 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:54.995387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:54.995839 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:54.996557 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:54.997236 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:54.997944 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:55.267451 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:55.277899 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a37b5bf6-193b-4d87-a9e4-955ba2725b29 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.295514 Aug 29 21:44:55.292618 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 483/977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:54 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:56.308145 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:56.309526 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:56.315516 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:56.316012 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:56.316446 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:56.317180 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:56.317638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:56.318067 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:56.804996 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:56.813687 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8756a2a1-25bc-45a9-84d2-f11574363e88 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.509435 Aug 29 21:44:56.814277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 495/978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:56 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:57.836032 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:57.837433 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:57.845053 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:57.845633 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:57.846134 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:57.847415 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:57.847415 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:57.850478 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:58.052679 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:58.065082 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9f232986-02ed-4009-aafc-e54c750ef778 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.232886 Aug 29 21:44:58.065997 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 484/979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:57 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:59.089268 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:59.089894 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:44:59.099790 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:59.100506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:59.101184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:59.101895 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:44:59.102525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:44:59.102953 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:44:59.108046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:59.285972 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:44:59.297530 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8fbd859a-1b81-4208-a941-f754455979b2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.211721 Aug 29 21:44:59.310158 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 496/980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:44:59 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:45:00.320869 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:00.321528 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:00.328022 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:00.328514 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:00.328987 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:00.329727 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:00.330211 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:00.330644 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:00.501292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:00.510563 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-b11d8c3f-559b-4fcf-a986-b9c752e604f2 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.193560 Aug 29 21:45:00.511294 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 485/981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:00 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:01.531984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:01.532745 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:01.539149 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:01.539632 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:01.540063 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:01.540779 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:01.541227 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:01.541644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:01.695395 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:01.704477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-dbe19c6f-ff5c-4352-91f3-ecd939fc06b0 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.176978 Aug 29 21:45:01.705659 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 497/982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:01 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:02.726196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:02.726811 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:02.733013 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:02.733492 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:02.733923 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:02.734857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:02.735309 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:02.735730 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:02.906820 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:02.916813 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c186352c-c712-4d65-9a94-036f79fa187d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.194590 Aug 29 21:45:02.917393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 486/983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:02 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:03.947177 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:03.947916 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:03.955495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:03.955983 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:03.956418 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:03.957149 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:03.957608 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:03.958030 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:04.108456 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:04.117036 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-a46a5278-0cb5-4206-ae54-41c228c20521 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.174026 Aug 29 21:45:04.117518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 498/984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:03 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:05.139109 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:05.139917 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:05.147792 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:05.148509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:05.149033 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:05.150142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:05.150610 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:05.151299 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:05.333056 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:05.344136 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-1a83900c-7d61-4224-b9fc-5004adbe4992 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.209946 Aug 29 21:45:05.345063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 487/985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:05 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:06.369016 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:06.369650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:06.377873 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:06.377986 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:06.378339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:06.379053 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:06.379517 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:06.379942 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:06.557263 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:06.566825 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-2a92e5fe-2a61-4d45-b68d-bf4f9b0fd6ee tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.201755 Aug 29 21:45:06.567397 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 499/986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:06 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:07.588804 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:07.589449 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:07.596851 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:07.597339 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:07.597782 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:07.598484 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:07.598935 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:07.599356 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:07.602201 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:07.760333 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:07.769681 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-069ecf31-b099-4518-a560-b3de13636c0c tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.184698 Aug 29 21:45:07.770292 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 488/987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:07 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:08.791641 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:08.792277 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:08.799325 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:08.800396 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:08.800865 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:08.801566 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:08.802019 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:08.802436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:09.037893 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:09.054652 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-ce765c6c-e781-46c0-8fb5-30348f905076 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.266540 Aug 29 21:45:09.055677 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 500/988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:08 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:10.077969 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:10.078597 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:10.085379 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:10.085864 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:10.086304 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:10.087011 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:10.087472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:10.087901 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:10.260229 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:10.269728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-88c02e33-47e7-427b-9076-d862c393038b tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1756 microversion: 2.1 time: 0.195824 Aug 29 21:45:10.270239 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 489/989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:10 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:11.291655 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:11.292286 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:11.299524 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:11.300001 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:11.300439 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:11.301143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:11.301593 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:11.302029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:11.450646 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:11.459448 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8d17ed33-6491-4417-ad1f-fa92d7878ca1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1759 microversion: 2.1 time: 0.171592 Aug 29 21:45:11.460029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 501/990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:11 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:16.804454 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:16.805093 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:16.807510 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=34 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:16.814329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:16.814628 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:16.818558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:16.818558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:16.818558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:16.818558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:16.842437 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lazy-loading 'flavor' on Instance uuid 1a5aa400-130f-4951-beee-2f3773dd590c {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:45:16.926954 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0a26ccbd-2502-45e7-bd43-24e128bf7b13 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c/action" status: 202 len: 0 microversion: 2.1 time: 0.126239 Aug 29 21:45:16.927562 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 490/991] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:45:16 2022] POST /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:45:16.935950 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:16.936605 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:16.939475 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:16.945197 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:16.945694 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:16.946136 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:16.946905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:16.947366 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:16.947795 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:17.089815 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:17.098382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-8d0286b6-92d0-4446-b6f9-7dc7e1fd7273 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.166289 Aug 29 21:45:17.098958 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 502/992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:16 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:18.120910 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:18.121506 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:18.128723 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:18.129216 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:18.129654 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:18.130358 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:18.130817 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:18.131616 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:18.270698 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:18.279196 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-074afb88-db8d-4810-b149-4333b3d39cbc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.162843 Aug 29 21:45:18.279770 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 491/993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:18 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:19.300155 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:19.300804 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:19.307709 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:19.308193 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:19.308659 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:19.309361 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:19.310314 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:19.310733 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:19.448525 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:19.457200 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5d356c29-71b3-42ff-ad10-f15e1c40a946 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.160967 Aug 29 21:45:19.457778 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 503/994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:19 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:20.482043 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:20.482708 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:20.489830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:20.490329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:20.490772 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:20.491480 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:20.491938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:20.492359 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:20.651993 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:20.662108 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-f0844e63-37b7-472b-9642-0903df876920 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.183862 Aug 29 21:45:20.663110 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 492/995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:20 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:21.684639 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:21.685788 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:21.692664 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:21.693143 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:21.693570 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:21.694275 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:21.694721 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:21.695140 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:21.857153 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:21.869628 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-31cc37c5-8893-43b6-8148-4416fd099cf3 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.188524 Aug 29 21:45:21.870575 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 504/996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:21 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:22.896409 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:22.897815 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:22.904170 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:22.904680 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:22.905152 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:22.905857 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:22.906317 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:22.906736 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:23.059919 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:23.067974 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-16dc6d2e-573f-49d1-9ace-8b91cc1f3f7e tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.175576 Aug 29 21:45:23.068555 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 493/997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:22 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:24.089855 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:24.090499 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:24.097102 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:24.097590 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:24.098029 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:24.098728 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:24.099188 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:24.099614 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:24.238731 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:24.246481 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-14743748-78d1-4866-b129-a6a30fe6dd59 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.160578 Aug 29 21:45:24.247657 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 505/998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:24 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:25.270187 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:25.271075 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:25.277886 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:25.278460 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:25.278906 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:25.279607 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:25.280071 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:25.280501 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:25.430962 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:25.442247 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-86f1b8ec-733a-49ab-8c15-c2e1b8cf6686 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.176341 Aug 29 21:45:25.442962 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 494/999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:25 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:26.471068 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:26.472072 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:26.479681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:26.480183 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:26.480651 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:26.481984 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:26.482330 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:26.482746 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:26.627578 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:26.635871 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-fe0d5843-bff7-4780-a362-35894dddb3ce tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.169004 Aug 29 21:45:26.636812 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 506/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:26 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:27.657378 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:27.658147 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:27.665065 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:27.665562 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:27.666002 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:27.666710 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:27.667177 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:27.667603 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:27.831582 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:27.840395 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e2aa7444-09e1-4970-abf1-ebf52c686f90 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.186882 Aug 29 21:45:27.841621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 495/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:27 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:28.866506 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:28.867204 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:28.874605 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:28.875184 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:28.875756 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:28.876784 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:28.877567 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:28.877746 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:29.134520 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:29.146889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-12c286fe-b2bc-4eb5-ad98-066677021861 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.287214 Aug 29 21:45:29.147712 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 507/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:28 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:45:30.173350 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:30.174042 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:30.180453 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:30.180968 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:30.181400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:30.182090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:30.182553 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:30.182977 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:30.322941 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:30.330908 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-024c2ff0-88d9-47d1-aa56-07e9dd7b4492 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.161969 Aug 29 21:45:30.331836 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 496/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:30 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:31.353651 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:31.354232 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:31.361870 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.362366 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.362946 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:31.363786 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.364496 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.365096 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:31.368123 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=71 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:31.545935 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:31.557586 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-931e973b-2280-4a8e-a24f-3f270f5b20d2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1570 microversion: 2.1 time: 0.207607 Aug 29 21:45:31.558385 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 508/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:31 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:31.585266 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:31.586150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:31.593927 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.594430 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.594927 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:31.595813 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.596360 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.596830 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:31.635140 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127217) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:45:31.716612 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9b8ee915-58ab-4d6e-aa36-c61536b328c2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c/action" status: 202 len: 0 microversion: 2.1 time: 0.134622 Aug 29 21:45:31.717351 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 497/1005] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:45:31 2022] POST /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:45:31.726195 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:31.726891 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:31.733339 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.733860 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.734393 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:31.735093 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.735545 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.735960 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:31.968882 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:31.986944 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-06ef1add-5e26-476b-b6a1-30e72c421cbe tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1518 microversion: 2.1 time: 0.264302 Aug 29 21:45:31.988390 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 509/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:31 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:45:33.017107 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:33.018219 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:33.026884 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:33.027370 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:33.027803 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:33.028933 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:33.029714 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:33.030477 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:33.203127 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:33.211938 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-9a475316-0de2-4045-8d4e-a65d15a7e68b tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1520 microversion: 2.1 time: 0.203239 Aug 29 21:45:33.212512 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 498/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:33 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:34.243130 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:34.244070 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:34.251751 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:34.252617 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:34.253344 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:34.254518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:34.255609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:34.255609 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:34.489675 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:34.500036 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-3e1d20e5-c10f-4d75-ab3d-8c80ac045b5a tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1576 microversion: 2.1 time: 0.262406 Aug 29 21:45:34.500683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 510/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:34 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:35.537052 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:35.538157 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:35.548460 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:35.548990 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:35.549443 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:35.550451 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:35.551296 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:35.552041 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:35.735347 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:35.747761 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-0bfe5bf5-2dde-473d-87a9-cbb30c7a85f7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1576 microversion: 2.1 time: 0.215592 Aug 29 21:45:35.748853 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 499/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:35 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:36.157410 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-dfaf881f-485c-4245-a19c-0f4f867deee8 req-719bc0a3-37ad-4b0e-b0b0-c9d1b68a5764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5aa400-130f-4951-beee-2f3773dd590c", "name": "network-vif-unplugged", "status": "completed", "tag": "8ba48673-7c7e-419d-94e5-60999c7e242e"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:36.167713 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-dfaf881f-485c-4245-a19c-0f4f867deee8 req-719bc0a3-37ad-4b0e-b0b0-c9d1b68a5764 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:36.168196 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-dfaf881f-485c-4245-a19c-0f4f867deee8 req-719bc0a3-37ad-4b0e-b0b0-c9d1b68a5764 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:36.169181 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-dfaf881f-485c-4245-a19c-0f4f867deee8 req-719bc0a3-37ad-4b0e-b0b0-c9d1b68a5764 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:36.185495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-dfaf881f-485c-4245-a19c-0f4f867deee8 req-719bc0a3-37ad-4b0e-b0b0-c9d1b68a5764 service nova] Creating event network-vif-unplugged:8ba48673-7c7e-419d-94e5-60999c7e242e for instance 1a5aa400-130f-4951-beee-2f3773dd590c on hv-cinder-85426 Aug 29 21:45:36.192966 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-dfaf881f-485c-4245-a19c-0f4f867deee8 req-719bc0a3-37ad-4b0e-b0b0-c9d1b68a5764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151590 Aug 29 21:45:36.193717 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 511/1010] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:36.780728 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:36.781646 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:36.790517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:36.791199 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:36.791756 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:36.792879 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:36.793400 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:36.794621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:36.987426 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:36.997929 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-4d860666-c764-4dab-a626-c0765454ddf2 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1576 microversion: 2.1 time: 0.223740 Aug 29 21:45:36.998517 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 500/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:36 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:38.036701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:38.037606 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:38.046055 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:38.046544 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:38.046975 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:38.047670 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:38.048120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:38.048534 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:38.220619 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:38.229358 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6d1e2c4e-6298-44c2-a72a-3746e7467d50 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1576 microversion: 2.1 time: 0.197856 Aug 29 21:45:38.229954 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 512/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:38 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:39.252627 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:39.253438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:39.263452 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:39.264142 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:39.264834 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:39.265828 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:39.266448 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:39.267038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:39.271038 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:39.428465 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:39.437259 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-16b3b4fb-6f2b-4671-82f5-4de559e4bb5d tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1576 microversion: 2.1 time: 0.189989 Aug 29 21:45:39.437981 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 501/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:39 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:40.460046 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:40.460905 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:40.467515 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:40.468002 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:40.468437 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:40.469160 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:40.469615 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:40.470038 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:40.621877 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:40.630273 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-6919c561-68f3-448f-b010-c1dc7b32d111 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1576 microversion: 2.1 time: 0.174079 Aug 29 21:45:40.630844 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 513/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:40 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:41.654326 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:41.655074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:41.661589 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:41.662074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:41.662509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:41.663225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:41.663686 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:41.664109 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:41.817408 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:41.829063 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-ac95643c-4ee8-4bed-8a72-c028a5aa6d04 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1576 microversion: 2.1 time: 0.181819 Aug 29 21:45:41.829850 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 502/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:41 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:42.852341 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:42.852978 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:42.859661 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:42.860169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:42.860628 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:42.861352 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:42.861814 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:42.862245 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:43.025683 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:43.037129 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-cdcf8b0d-33b2-449a-8852-585f164977dc tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1563 microversion: 2.1 time: 0.188510 Aug 29 21:45:43.037739 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 514/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:42 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:44.688285 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1121181353"}} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:44.689154 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:44.698598 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:44.699090 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:44.699536 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:44.700827 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:44.701286 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:44.701720 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:44.848786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.network.security_group_api [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Removing security group 6f349097-fcc6-4020-ae5a-afa186258501 from port 01de6740-c3e7-4663-ae6d-d1f005bc9acc Aug 29 21:45:45.483047 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-40585e93-772b-4d9f-a900-727e402afdb1 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.799258 Aug 29 21:45:45.483661 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 503/1017] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 21:45:44 2022] POST /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:45:45.642659 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-fca62027-4fd3-48f5-8b6e-89c2c784c079 req-845a8c18-d29e-4db2-b6c9-4f2ccd685997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abd7bcf-c166-4f1e-bb3b-094b5b189a9b", "tag": "01de6740-c3e7-4663-ae6d-d1f005bc9acc"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:45.663943 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fca62027-4fd3-48f5-8b6e-89c2c784c079 req-845a8c18-d29e-4db2-b6c9-4f2ccd685997 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:45.665275 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fca62027-4fd3-48f5-8b6e-89c2c784c079 req-845a8c18-d29e-4db2-b6c9-4f2ccd685997 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:45.666128 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fca62027-4fd3-48f5-8b6e-89c2c784c079 req-845a8c18-d29e-4db2-b6c9-4f2ccd685997 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:45.689104 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-fca62027-4fd3-48f5-8b6e-89c2c784c079 req-845a8c18-d29e-4db2-b6c9-4f2ccd685997 service nova] Creating event network-changed:01de6740-c3e7-4663-ae6d-d1f005bc9acc for instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b on hv-cinder-85426 Aug 29 21:45:45.699712 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-fca62027-4fd3-48f5-8b6e-89c2c784c079 req-845a8c18-d29e-4db2-b6c9-4f2ccd685997 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207440 Aug 29 21:45:45.701576 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 515/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:46.358485 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-d263aefb-8b43-417d-9f8d-c38fb9416a50 req-433110e0-b587-45c9-a1eb-feb4654e36d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5aa400-130f-4951-beee-2f3773dd590c", "name": "network-vif-plugged", "status": "completed", "tag": "8ba48673-7c7e-419d-94e5-60999c7e242e"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:46.376197 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d263aefb-8b43-417d-9f8d-c38fb9416a50 req-433110e0-b587-45c9-a1eb-feb4654e36d4 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:46.377621 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d263aefb-8b43-417d-9f8d-c38fb9416a50 req-433110e0-b587-45c9-a1eb-feb4654e36d4 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:46.378835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d263aefb-8b43-417d-9f8d-c38fb9416a50 req-433110e0-b587-45c9-a1eb-feb4654e36d4 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:46.401637 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-d263aefb-8b43-417d-9f8d-c38fb9416a50 req-433110e0-b587-45c9-a1eb-feb4654e36d4 service nova] Creating event network-vif-plugged:8ba48673-7c7e-419d-94e5-60999c7e242e for instance 1a5aa400-130f-4951-beee-2f3773dd590c on hv-cinder-85426 Aug 29 21:45:46.410655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-d263aefb-8b43-417d-9f8d-c38fb9416a50 req-433110e0-b587-45c9-a1eb-feb4654e36d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059654 Aug 29 21:45:46.412474 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 504/1019] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:47.163436 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:47.164364 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:47.172203 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=28 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:47.193912 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:47.194686 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:47.195247 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:47.196026 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:47.196789 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:47.197477 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:47.251159 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-d4e37044-56db-4fdf-87e6-e59f2e5df756 req-3be9b2aa-121f-4d51-953f-abf8fe4f04a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abd7bcf-c166-4f1e-bb3b-094b5b189a9b", "tag": "01de6740-c3e7-4663-ae6d-d1f005bc9acc"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:47.256823 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:47.266732 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d4e37044-56db-4fdf-87e6-e59f2e5df756 req-3be9b2aa-121f-4d51-953f-abf8fe4f04a2 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:47.267222 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d4e37044-56db-4fdf-87e6-e59f2e5df756 req-3be9b2aa-121f-4d51-953f-abf8fe4f04a2 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:47.267689 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-d4e37044-56db-4fdf-87e6-e59f2e5df756 req-3be9b2aa-121f-4d51-953f-abf8fe4f04a2 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:47.290005 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-d4e37044-56db-4fdf-87e6-e59f2e5df756 req-3be9b2aa-121f-4d51-953f-abf8fe4f04a2 service nova] Creating event network-changed:01de6740-c3e7-4663-ae6d-d1f005bc9acc for instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b on hv-cinder-85426 Aug 29 21:45:47.297751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-d4e37044-56db-4fdf-87e6-e59f2e5df756 req-3be9b2aa-121f-4d51-953f-abf8fe4f04a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135904 Aug 29 21:45:47.298718 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 505/1020] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:47.551890 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lazy-loading 'services' on Instance uuid 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:45:47.688400 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-59de7df7-8b7e-4b7b-8914-f3dc4caf96b7 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments/df47d675-a03f-4161-b68f-dca6c81c63cf" status: 202 len: 0 microversion: 2.1 time: 0.532318 Aug 29 21:45:47.694561 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 516/1021] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:45:47 2022] DELETE /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments/df47d675-a03f-4161-b68f-dca6c81c63cf => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:45:47.703290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:47.706225 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:47.714503 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:47.715434 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:47.716057 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:47.716997 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:47.719026 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:47.720529 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:47.775907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-71fdc811-8366-4e29-9576-7defbbb8e57d tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079214 Aug 29 21:45:47.777026 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 506/1022] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:45:47 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:48.792701 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:48.795638 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:48.802856 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:48.803432 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:48.803920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:48.804782 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:48.805323 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:48.805802 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:48.838316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-adfa3899-90d2-4b55-adbb-9f46a8249dd5 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050670 Aug 29 21:45:48.838898 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 517/1023] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 21:45:48 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:45:48.857509 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:48.858393 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:48.869472 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:48.869976 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:48.870410 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:48.871141 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:48.871594 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:48.872609 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:48.961097 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] HTTP exception thrown: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b is not attached to volume df47d675-a03f-4161-b68f-dca6c81c63cf Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Request method failure captured: Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: DELETE /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments/df47d675-a03f-4161-b68f-dca6c81c63cf HTTP/1.1 Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTL2yqlNCx05-_8yFOh9NGzDPfHkcQlKvg_bHpXHLuJK7H7FWcZWPxxM3iJxIeGORDaVChX_h1dDf5jcme_Gm0DXCKlR4-eM8BAFHRjuMspZEtLiklyJ-wdnPDfboQ9gzP3DWRXFWdh-S7fEMTT9UJS27mdeoz0ZPbpcfM6WmYa4hj4 Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 84b949156c47430fae4f516e4c6d80ba Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-TestMinimumBasicScenario-1434664452 Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:45:48.963496 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84b949156c47430fae4f516e4c6d80ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84b949156c47430fae4f516e4c6d80ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84b949156c47430fae4f516e4c6d80ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84b949156c47430fae4f516e4c6d80ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-TestMinimumBasicScenario-1434664452 Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 84b949156c47430fae4f516e4c6d80ba Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1434664452 Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-TestMinimumBasicScenario-1434664452-project Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: ec929ddc024a4790b7091f60e4733cd4 Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-TestMinimumBasicScenario-1434664452-project Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:45:48.966183 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b is not attached to volume df47d675-a03f-4161-b68f-dca6c81c63cf Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'server_id': '2abd7bcf-c166-4f1e-bb3b-094b5b189a9b', 'id': 'df47d675-a03f-4161-b68f-dca6c81c63cf'} Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id df47d675-a03f-4161-b68f-dca6c81c63cf. Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:45:48.967490 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b is not attached to volume df47d675-a03f-4161-b68f-dca6c81c63cf Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b is not attached to volume df47d675-a03f-4161-b68f-dca6c81c63cf Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:48.969963 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Returning 404 to user: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b is not attached to volume df47d675-a03f-4161-b68f-dca6c81c63cf {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:45:48.971854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-c8f43164-8e98-4ee8-841b-bbedab833765 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments/df47d675-a03f-4161-b68f-dca6c81c63cf" status: 404 len: 154 microversion: 2.1 time: 0.116291 Aug 29 21:45:48.971854 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 507/1024] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 21:45:48 2022] DELETE /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b/os-volume_attachments/df47d675-a03f-4161-b68f-dca6c81c63cf => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:45:50.136538 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:50.137185 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:50.145009 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:50.145501 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:50.145934 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:50.146644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:50.147098 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:50.147514 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:50.176971 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Going to try to terminate instance {{(pid=127216) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:45:50.275791 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-f9ab3bfc-d400-41ca-8cd7-1bd846077c7e tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 204 len: 0 microversion: 2.1 time: 0.142923 Aug 29 21:45:50.276381 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 518/1025] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:45:50 2022] DELETE /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:45:50.287548 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:50.288290 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:50.295807 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:50.296350 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:50.296916 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:50.297636 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:50.298115 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:50.298546 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:50.453195 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:50.461948 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-689341e6-a445-4d81-874d-e00396d0f201 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1553 microversion: 2.1 time: 0.179848 Aug 29 21:45:50.462558 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 508/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:50 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:51.486495 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:51.487290 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:51.495626 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:51.496169 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:51.497173 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:51.497906 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:51.499047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:51.499047 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:51.686421 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:51.695209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-e2ae54f2-5486-4ee7-b8b7-264d04a6857f tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1553 microversion: 2.1 time: 0.214523 Aug 29 21:45:51.695755 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 519/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:51 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:52.629387 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [req-976a6a7c-ec64-467b-9f4d-18572cf97b92 req-20e21457-869d-4af2-8019-97447553ed8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abd7bcf-c166-4f1e-bb3b-094b5b189a9b", "name": "network-vif-deleted", "tag": "01de6740-c3e7-4663-ae6d-d1f005bc9acc"}]} {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:52.647076 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-976a6a7c-ec64-467b-9f4d-18572cf97b92 req-20e21457-869d-4af2-8019-97447553ed8d service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:52.647678 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-976a6a7c-ec64-467b-9f4d-18572cf97b92 req-20e21457-869d-4af2-8019-97447553ed8d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:52.648660 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [req-976a6a7c-ec64-467b-9f4d-18572cf97b92 req-20e21457-869d-4af2-8019-97447553ed8d service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:52.664542 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.compute.server_external_events [req-976a6a7c-ec64-467b-9f4d-18572cf97b92 req-20e21457-869d-4af2-8019-97447553ed8d service nova] Creating event network-vif-deleted:01de6740-c3e7-4663-ae6d-d1f005bc9acc for instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b on hv-cinder-85426 Aug 29 21:45:52.671495 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [req-976a6a7c-ec64-467b-9f4d-18572cf97b92 req-20e21457-869d-4af2-8019-97447553ed8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047484 Aug 29 21:45:52.674579 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 509/1028] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:52.718019 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:52.718990 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:52.725409 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:52.725889 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:52.726316 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:52.727120 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:52.727508 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:52.727919 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:52.770004 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:52.770823 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:52.771512 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:52.772246 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.objects.instance [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lazy-loading 'fault' on Instance uuid 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b {{(pid=127216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:45:52.821284 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec929ddc024a4790b7091f60e4733cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b949156c47430fae4f516e4c6d80ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:52.831209 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-9a942813-14e0-4476-80c6-4befa77a64c9 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 200 len: 1348 microversion: 2.1 time: 0.116582 Aug 29 21:45:52.831645 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 520/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:52 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 1348 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:53.856747 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:53.857835 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] [instance: 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:53.868128 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:53.868671 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:53.869179 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:53.869999 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:53.870648 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:53.871228 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:53.888812 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.wsgi [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] HTTP exception thrown: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b could not be found. Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Request method failure captured: Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: request: GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b HTTP/1.1 Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept: application/json Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Accept-Encoding: identity Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Connection: close Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Length: 0 Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Content-Type: application/json Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Host: 10.222.0.20 Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: Openstack-System-Scope: None Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: User-Agent: python-urllib3/1.26.12 Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Auth-Token: gAAAAABjDTL2yqlNCx05-_8yFOh9NGzDPfHkcQlKvg_bHpXHLuJK7H7FWcZWPxxM3iJxIeGORDaVChX_h1dDf5jcme_Gm0DXCKlR4-eM8BAFHRjuMspZEtLiklyJ-wdnPDfboQ9gzP3DWRXFWdh-S7fEMTT9UJS27mdeoz0ZPbpcfM6WmYa4hj4 Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Id: None Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Domain-Name: None Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Identity-Status: Confirmed Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Is-Admin-Project: True Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Id: default Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Domain-Name: Default Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Id: 84b949156c47430fae4f516e4c6d80ba Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Project-Name: tempest-TestMinimumBasicScenario-1434664452 Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Role: member,reader Aug 29 21:45:53.890493 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Roles: member,reader Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84b949156c47430fae4f516e4c6d80ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84b949156c47430fae4f516e4c6d80ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84b949156c47430fae4f516e4c6d80ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84b949156c47430fae4f516e4c6d80ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant: tempest-TestMinimumBasicScenario-1434664452 Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Id: 84b949156c47430fae4f516e4c6d80ba Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1434664452 Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User: tempest-TestMinimumBasicScenario-1434664452-project Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Id: default Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Domain-Name: Default Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Id: ec929ddc024a4790b7091f60e4733cd4 Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: X-User-Name: tempest-TestMinimumBasicScenario-1434664452-project Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: method: > Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: exception: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b could not be found. Aug 29 21:45:53.893074 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: action_args: {'id': '2abd7bcf-c166-4f1e-bb3b-094b5b189a9b'} Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b could not be found. Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:45:53.894630 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b could not be found. Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b could not be found. Aug 29 21:45:53.896801 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: ERROR nova.api.openstack.wsgi Aug 29 21:45:53.898746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Returning 404 to user: Instance 2abd7bcf-c166-4f1e-bb3b-094b5b189a9b could not be found. {{(pid=127217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:45:53.898746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-300edb04-54e4-4b5c-a699-e5eb78496cfd tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b" status: 404 len: 111 microversion: 2.1 time: 0.042673 Aug 29 21:45:53.898746 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 510/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:53 2022] GET /compute/v2.1/servers/2abd7bcf-c166-4f1e-bb3b-094b5b189a9b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:45:53.906920 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5f463017-9722-43b4-82ee-5f7472208553 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] Calling method '.version_select at 0x7f54029e7160>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:53.938650 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5f463017-9722-43b4-82ee-5f7472208553 tempest-TestMinimumBasicScenario-1434664452 tempest-TestMinimumBasicScenario-1434664452-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-644343801" status: 202 len: 0 microversion: 2.1 time: 0.038495 Aug 29 21:45:53.939690 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 521/1031] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 21:45:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-644343801 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:46:57.814786 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_api:SELECT=11 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:57.816262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:57.816262 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG dbcounter [-] [127216] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:57.817422 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG dbcounter [-] [127217] Writing DB stats nova_cell1:SELECT=41 {{(pid=127217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:57.824999 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-fe227d2f-58b1-430e-886e-6f442a056105 req-3b77954b-3a65-46f6-a834-42598434ed73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5aa400-130f-4951-beee-2f3773dd590c", "tag": "8ba48673-7c7e-419d-94e5-60999c7e242e"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:46:57.826150 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:57.826751 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:57.838402 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:57.839329 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:57.842748 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:57.842748 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:57.843305 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:57.843684 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:57.848155 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fe227d2f-58b1-430e-886e-6f442a056105 req-3b77954b-3a65-46f6-a834-42598434ed73 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:57.848872 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fe227d2f-58b1-430e-886e-6f442a056105 req-3b77954b-3a65-46f6-a834-42598434ed73 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:57.849411 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-fe227d2f-58b1-430e-886e-6f442a056105 req-3b77954b-3a65-46f6-a834-42598434ed73 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:57.876504 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-fe227d2f-58b1-430e-886e-6f442a056105 req-3b77954b-3a65-46f6-a834-42598434ed73 service nova] Creating event network-changed:8ba48673-7c7e-419d-94e5-60999c7e242e for instance 1a5aa400-130f-4951-beee-2f3773dd590c on hv-cinder-85426 Aug 29 21:46:57.882382 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-fe227d2f-58b1-430e-886e-6f442a056105 req-3b77954b-3a65-46f6-a834-42598434ed73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071943 Aug 29 21:46:57.883748 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 522/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:46:57.894470 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Going to try to terminate instance {{(pid=127217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:46:58.044069 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-e38db20a-9704-48aa-bae4-695358257866 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 204 len: 0 microversion: 2.1 time: 0.235341 Aug 29 21:46:58.044855 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 511/1033] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 21:46:57 2022] DELETE /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:46:58.057108 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:58.059223 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:58.067610 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:58.068518 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:58.069022 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:58.070113 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:58.070826 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:58.071322 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:58.327888 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.policy [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:58.342170 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-07d5c602-7434-41f9-88bd-cd288b672b11 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.291023 Aug 29 21:46:58.343177 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 523/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:58 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:46:59.375413 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:46:59.376189 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:46:59.383787 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:59.384275 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:59.384738 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:59.385438 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:46:59.385890 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:46:59.386843 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:46:59.611871 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:46:59.626420 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-a241ee4a-c7b9-415b-b05a-e90bd7267087 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1569 microversion: 2.1 time: 0.257235 Aug 29 21:46:59.627709 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 512/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:46:59 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:47:00.177838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [req-3dbb2560-cddd-46c0-bd7c-eed2a4192c12 req-37598932-1f2a-4b47-842c-c65025ef1393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5aa400-130f-4951-beee-2f3773dd590c", "name": "network-vif-deleted", "tag": "8ba48673-7c7e-419d-94e5-60999c7e242e"}]} {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:47:00.189138 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-3dbb2560-cddd-46c0-bd7c-eed2a4192c12 req-37598932-1f2a-4b47-842c-c65025ef1393 service nova] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:00.190437 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-3dbb2560-cddd-46c0-bd7c-eed2a4192c12 req-37598932-1f2a-4b47-842c-c65025ef1393 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:00.190437 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [req-3dbb2560-cddd-46c0-bd7c-eed2a4192c12 req-37598932-1f2a-4b47-842c-c65025ef1393 service nova] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:00.203278 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.compute.server_external_events [req-3dbb2560-cddd-46c0-bd7c-eed2a4192c12 req-37598932-1f2a-4b47-842c-c65025ef1393 service nova] Creating event network-vif-deleted:8ba48673-7c7e-419d-94e5-60999c7e242e for instance 1a5aa400-130f-4951-beee-2f3773dd590c on hv-cinder-85426 Aug 29 21:47:00.209644 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [req-3dbb2560-cddd-46c0-bd7c-eed2a4192c12 req-37598932-1f2a-4b47-842c-c65025ef1393 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035879 Aug 29 21:47:00.210883 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 524/1036] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 21:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:47:00.663691 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:00.669887 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.compute.api [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:00.673807 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:00.674328 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:00.674953 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:00.675682 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:00.676149 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:00.676629 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:00.725218 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:00.725737 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:00.726153 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG oslo_concurrency.lockutils [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:00.726907 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.objects.instance [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lazy-loading 'fault' on Instance uuid 1a5aa400-130f-4951-beee-2f3773dd590c {{(pid=127217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:47:00.788647 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.policy [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a20bdc6eee841258bd6ac11a8095a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9fa722c18045678015c7b300ccc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:00.804546 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-445e19e4-f432-49e1-9b4d-febb2cd28394 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 200 len: 1224 microversion: 2.1 time: 0.146513 Aug 29 21:47:00.805655 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 513/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:00 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:01.834827 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '>' {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:01.835681 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.compute.api [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] [instance: 1a5aa400-130f-4951-beee-2f3773dd590c] Fetching instance by UUID {{(pid=127216) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:01.845094 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:01.845983 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:01.846772 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:01.847900 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Acquiring lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:01.848542 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:01.849099 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG oslo_concurrency.lockutils [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Lock "c54f11d2-4653-47b4-ba10-e11e8c2fda2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:01.873036 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.wsgi [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] HTTP exception thrown: Instance 1a5aa400-130f-4951-beee-2f3773dd590c could not be found. Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Request method failure captured: Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: request: GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c HTTP/1.1 Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept: application/json Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Accept-Encoding: identity Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Connection: close Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Length: 0 Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Content-Type: application/json Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Host: 10.222.0.20 Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: Openstack-System-Scope: None Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: User-Agent: python-urllib3/1.26.12 Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Auth-Token: gAAAAABjDTKf_jRDLnzQg2fdNCURf4-e_alu-144m_VAqCZ37gk10ExPTBJVShys_9IdvbJ8yltedytQn1-sWaNX9E3UpOgOFtA6AYHL9X2zSk76OVG9HIIgT5hwQQKguXNDI-sOkYKjjcFyIK_F4jxd-GGh7d5QgqMnWuMqdH3HRT7Tj_Vapuk Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Id: None Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Domain-Name: None Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Identity-Status: Confirmed Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Is-Admin-Project: True Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Id: default Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Domain-Name: Default Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Id: 2d9fa722c18045678015c7b300ccc3ab Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Project-Name: tempest-TestShelveInstance-263460768 Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Role: member,reader Aug 29 21:47:01.875913 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Roles: member,reader Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2d9fa722c18045678015c7b300ccc3ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9fa722c18045678015c7b300ccc3ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9fa722c18045678015c7b300ccc3ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2d9fa722c18045678015c7b300ccc3ab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant: tempest-TestShelveInstance-263460768 Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Id: 2d9fa722c18045678015c7b300ccc3ab Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-Tenant-Name: tempest-TestShelveInstance-263460768 Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User: tempest-TestShelveInstance-263460768-project Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Id: default Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Domain-Name: Default Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Id: 4a20bdc6eee841258bd6ac11a8095a4a Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: X-User-Name: tempest-TestShelveInstance-263460768-project Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: method: > Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: exception: Instance 1a5aa400-130f-4951-beee-2f3773dd590c could not be found. Aug 29 21:47:01.877911 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: action_args: {'id': '1a5aa400-130f-4951-beee-2f3773dd590c'} Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: {{(pid=127216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5aa400-130f-4951-beee-2f3773dd590c could not be found. Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:47:01.879042 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5aa400-130f-4951-beee-2f3773dd590c could not be found. Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5aa400-130f-4951-beee-2f3773dd590c could not be found. Aug 29 21:47:01.880838 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: ERROR nova.api.openstack.wsgi Aug 29 21:47:01.882345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: DEBUG nova.api.openstack.wsgi [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Returning 404 to user: Instance 1a5aa400-130f-4951-beee-2f3773dd590c could not be found. {{(pid=127216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:47:01.882345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: INFO nova.api.openstack.requestlog [None req-5a0600f0-addc-4128-b83d-ed012e55efee tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c" status: 404 len: 111 microversion: 2.1 time: 0.049680 Aug 29 21:47:01.882345 dv-cinder-854266-3-iscsi devstack@n-api.service[127216]: [pid: 127216|app: 0|req: 525/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:01 2022] GET /compute/v2.1/servers/1a5aa400-130f-4951-beee-2f3773dd590c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:47:02.127473 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: DEBUG nova.api.openstack.wsgi [None req-739c4666-3f1c-4bde-8c57-329d7d3d2ce7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] Calling method '.version_select at 0x7f5402ad84c0>' {{(pid=127217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:02.172658 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: INFO nova.api.openstack.requestlog [None req-739c4666-3f1c-4bde-8c57-329d7d3d2ce7 tempest-TestShelveInstance-263460768 tempest-TestShelveInstance-263460768-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-761554983" status: 202 len: 0 microversion: 2.1 time: 0.051639 Aug 29 21:47:02.173508 dv-cinder-854266-3-iscsi devstack@n-api.service[127217]: [pid: 127217|app: 0|req: 514/1039] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 21:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-761554983 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)